-- Logs begin at Wed 2022-07-20 16:48:47 UTC, end at Wed 2022-07-20 18:09:42 UTC. -- Jul 20 17:40:18.954037 dv-cinder-849846-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 17:40:18.965349 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 17:40:18 2022] *** Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: nodename: dv-cinder-849846-3-iscsi Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: machine: x86_64 Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: clock source: unix Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: pcre jit disabled Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: detected number of CPU cores: 4 Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: current working directory: / Jul 20 17:40:18.967304 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: detected binary path: /usr/bin/uwsgi-core Jul 20 17:40:18.967984 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: your processes number limit is 47680 Jul 20 17:40:18.967984 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: your memory page size is 4096 bytes Jul 20 17:40:18.967984 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: detected max file descriptor number: 2048 Jul 20 17:40:18.967984 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: lock engine: pthread robust mutexes Jul 20 17:40:18.967984 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: thunder lock: enabled Jul 20 17:40:18.967984 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 17:40:18.967984 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 17:40:19.011433 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: Python main interpreter initialized at 0x561a119029c0 Jul 20 17:40:19.011433 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: python threads support enabled Jul 20 17:40:19.011433 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: your server socket listen backlog is limited to 100 connections Jul 20 17:40:19.011433 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: your mercy for graceful operations on workers is 90 seconds Jul 20 17:40:19.011814 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 17:40:19.011892 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: *** Operational MODE: preforking *** Jul 20 17:40:19.012107 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: *** uWSGI is running in multiple interpreter mode *** Jul 20 17:40:19.012107 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: spawned uWSGI master process (pid: 110304) Jul 20 17:40:19.012305 dv-cinder-849846-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 17:40:19.012907 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: spawned uWSGI worker 1 (pid: 110305, cores: 1) Jul 20 17:40:19.016486 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: spawned uWSGI worker 2 (pid: 110306, cores: 1) Jul 20 17:40:19.016486 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 17:40:19.672055 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 17:40:19.679296 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 17:40:20.802526 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:40:20.802526 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: from cryptography.utils import int_from_bytes Jul 20 17:40:20.803180 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:40:20.803180 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: from cryptography.utils import int_from_bytes Jul 20 17:40:20.804427 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:40:20.804427 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: from cryptography.utils import int_from_bytes Jul 20 17:40:20.807125 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:40:20.807125 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: from cryptography.utils import int_from_bytes Jul 20 17:40:23.287298 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 17:40:23.287852 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 17:40:23.288048 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 17:40:23.288403 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 17:40:23.288684 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 17:40:23.289050 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 17:40:23.289155 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 17:40:23.289237 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.289376 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.289464 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 17:40:23.289692 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.289798 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 17:40:23.290002 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.290099 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 17:40:23.290323 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.290419 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.290628 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.290723 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.290942 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.291044 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.291256 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.291354 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.291574 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.291670 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.291829 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.291916 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.292135 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.292230 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.292470 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-3-iscsi {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.292584 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.292790 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.292897 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.293074 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.293175 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.293379 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.293465 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.293689 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.293774 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-3-iscsi {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.293986 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.294084 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.294290 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.294382 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.294584 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.294670 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.294893 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.295070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.295180 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.296213 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.296356 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.296486 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.296587 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.296587 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.296792 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.296894 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.296979 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.297113 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.297196 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.297286 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.297371 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.297495 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.297577 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.297669 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.297775 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.297907 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.298077 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.298209 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.298389 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.298594 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-3-iscsi {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.298681 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.299162 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.299257 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.299467 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.299555 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.299774 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.299911 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-3-iscsi {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.300175 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.300269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.300546 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.300668 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.300889 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.300987 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.301103 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.301249 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.301427 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.301528 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.301727 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.301816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.302044 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.302137 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.302888 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.303045 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.303200 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.303294 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.303511 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.303604 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.303805 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.303900 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.304108 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.304195 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.304410 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.304561 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.304741 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.304843 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.305039 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.305134 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.305335 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.305422 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.305581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.305696 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.305879 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.305996 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.306193 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.306280 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.306506 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.306602 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.306815 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.306902 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.307060 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.307165 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.307305 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.307431 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.307615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.307746 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.307926 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.308029 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.308226 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.308313 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.308552 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.308643 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.308853 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.308941 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.309156 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.309243 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.309456 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.309548 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.309752 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.309880 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.310050 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.310136 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.310347 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.310446 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.310646 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.310740 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.310947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.311041 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.311247 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.311343 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.311545 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.311630 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.311853 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.311998 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.312169 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.312265 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.312488 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.312577 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.312808 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.312910 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.313125 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.313224 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.313418 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.313505 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.313723 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.313816 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.314031 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.314130 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.314343 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.314437 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.314641 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.314735 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.314938 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.315036 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.315236 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.315329 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.315540 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.315626 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.315841 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.315929 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.316141 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.316240 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.316383 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.316526 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.316700 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.316788 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.316996 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.317090 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.317307 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.317400 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.317602 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.317695 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.317922 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.318008 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.318221 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.318317 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.318512 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.318599 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.318808 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.318894 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.319108 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.319203 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.319400 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.319485 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.319696 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.319781 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.319992 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.320086 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.320286 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.320371 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.320607 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.320695 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.320904 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.321002 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.321200 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.321322 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.321498 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.321584 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.321797 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.321896 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.322094 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.322189 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.322389 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.322475 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.322687 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.322782 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.322983 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.323070 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.323277 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.323364 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.323574 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.323670 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.323869 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.323957 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.324180 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.324268 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.324496 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.324599 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.324795 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.324880 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.325104 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.325190 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.325400 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.325487 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.325694 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.325780 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.326003 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.326096 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.326295 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.326387 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.326592 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.326678 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.326898 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.326983 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.327192 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.327334 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.327487 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.327580 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.327781 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.327874 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.328076 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.328164 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.328368 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.328480 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.328688 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.328775 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.328981 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.329068 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.329279 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.329365 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.329570 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.329665 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.329862 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.329948 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.330160 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.330301 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.330446 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.330591 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.330748 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.330885 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.331027 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.331162 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.331337 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.331488 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.331622 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.331766 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.331910 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.332047 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.332218 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:40:23.332359 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.332587 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.332720 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.332883 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.333021 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.333270 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.333416 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.333561 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.333702 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.333838 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.333973 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.334139 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.334277 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.334459 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.334603 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.334764 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.334900 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.335069 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.335216 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.335373 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.335518 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.335682 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.335830 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.335988 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.336125 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.336294 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.336450 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.336628 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.336776 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.336919 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.337065 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.337232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.337376 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.337521 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.337671 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.337816 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.337956 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.338132 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.338269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.338434 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.338579 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.338718 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.338850 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.339058 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.339195 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.339369 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.339513 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.339673 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.339810 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.339990 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.340133 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.340305 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.340495 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.340628 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.340765 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.340926 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.341072 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.341219 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.341354 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.341532 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.341675 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.341833 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.341976 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.342121 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.342254 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.342438 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.342576 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.342741 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.342877 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.343037 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.343172 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.343321 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.343517 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.343658 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.343793 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.343939 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.344075 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.344209 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.344343 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.344528 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.344672 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.344819 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.344957 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.345145 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.345282 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.345456 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.345599 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.345760 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.345895 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.346062 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.346197 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.346365 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.346509 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.346663 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.346809 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.346952 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.347088 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.347290 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.347517 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.347653 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.347788 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.347922 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.348058 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.348198 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.348343 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.348498 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.348631 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.348777 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.348914 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.349543 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.349682 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.349847 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.349980 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.350153 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.350306 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.350451 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.350586 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.350752 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.350883 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.351054 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.351203 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.351355 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.351490 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.351632 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.351769 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.351932 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.352065 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.352239 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.352373 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.352552 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.352689 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.352853 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.352992 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.353167 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.353305 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.353465 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.353675 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.353809 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.353951 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.354088 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.354222 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.354358 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.354490 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.354632 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.354775 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.354921 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.355056 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.355218 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.355350 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.355487 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.355629 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.355795 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.355932 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.356100 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.356236 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.356418 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.356582 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.356748 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.356897 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.357034 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.357169 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.357350 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.357488 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.357668 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.357799 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.357963 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.358098 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.358252 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.358388 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.358552 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.358684 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.358853 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.358991 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.359136 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.359272 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.359438 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.359568 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.359742 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.359886 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.360022 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.360163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.360320 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.360497 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.360641 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.360789 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.360924 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.361058 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.361191 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.361326 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.361496 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.361640 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.361778 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.361921 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.362068 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.362199 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.362367 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.362524 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.362659 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.362795 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.362930 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.363062 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.363231 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.363368 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.363526 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.363677 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.363861 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.363960 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.364161 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.364250 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.364519 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.364656 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.365381 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.365484 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.365695 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.365783 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.366002 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.366096 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.366309 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.366396 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.366612 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.366699 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.366917 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.367011 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.367221 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.367321 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.367524 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.367609 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.367826 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.367912 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.368127 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.368220 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.368469 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.368558 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.368757 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.368842 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.369061 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.369160 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.369359 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.369452 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.369674 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.369762 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.369985 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.370086 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.370284 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.370373 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.370593 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.370682 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.370915 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.371010 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.371220 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.371314 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.371528 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.371615 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.371831 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.371919 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.372135 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.372229 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.372453 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.372553 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.372761 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.372848 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.373066 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.373153 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.373368 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.373453 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.373674 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.373760 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.373998 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.374099 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.374278 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.374372 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.374580 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.374667 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.374881 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.374968 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.375175 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.375278 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.375484 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.375570 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.375793 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.375878 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.376091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.376253 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.376401 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.376512 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.376740 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.376826 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.377055 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.377151 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.377357 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.377498 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.377658 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.377790 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.377960 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.378104 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.378259 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.378390 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.378558 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.378690 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.378861 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.378994 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.379159 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.379290 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.379459 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.379590 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.379767 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.379898 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.380062 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.380192 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.380396 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.380575 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.380730 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.380868 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.381010 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.381147 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.381282 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.381417 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.381560 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.381705 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.381875 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.382012 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.382171 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.382313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.382476 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.382565 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.382785 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.382871 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.383080 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.383180 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.383376 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.383463 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.383690 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.383821 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.383987 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.384082 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.384281 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.384367 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.384602 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.384694 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.384899 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.384998 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.385208 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.385302 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.385506 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.385593 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.385803 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.385903 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.386108 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.386193 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.386421 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.386507 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.386716 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.386803 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.387020 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.387105 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.387321 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.387415 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.387618 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.387705 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.387924 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.388020 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.388228 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.388318 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.388552 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.388642 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.388855 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.388952 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.389156 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.389251 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.389454 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.389541 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.389759 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.389847 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.390060 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.390157 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.390359 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.390445 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.390658 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.390750 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.390958 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.391057 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.391254 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.391348 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.391553 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.391639 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.391854 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.391954 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.392149 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.392412 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.392525 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.392762 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.392849 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.393071 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.393313 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.393400 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.393639 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.393732 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.393946 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.394034 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.394255 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.394345 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.394566 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.394654 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.394877 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.394965 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.395184 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.395279 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.395487 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.395573 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.395784 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.395879 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.396126 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.396231 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.396451 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.396539 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.396748 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.396834 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.397049 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.397138 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.397347 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.397441 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.397644 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.397738 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.397937 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.398029 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.398232 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.398318 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.398525 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.398610 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.398818 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.398912 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.399115 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.399202 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.399411 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.399497 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.399711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.399806 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.400007 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.400093 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.400300 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.400397 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.400626 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.400715 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.400921 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.401009 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.401219 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.401319 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.401519 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.401607 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.401813 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.401898 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.402111 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.402206 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.402408 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.402504 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.402742 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.402829 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.403041 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.403136 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.403371 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.403458 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.403672 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.403759 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.403990 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.404078 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.404288 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.404382 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.404613 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.404702 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.404909 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.404995 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.405209 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.405296 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.405504 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.405589 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.405797 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.405891 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.406096 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.406181 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.406411 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.406512 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.406687 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.406774 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.406988 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.407074 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.407284 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.407378 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.407583 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.407670 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.407876 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.407963 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.408169 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.408263 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.408488 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.408580 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.408786 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.408876 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.409081 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.409184 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.409381 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.409467 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.409683 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.409776 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.409977 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.410064 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.410276 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.410376 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.410573 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.410660 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.410868 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.410954 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.411169 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.411255 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.411462 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.411548 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.412493 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.412579 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.412659 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.412737 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.412884 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.412981 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.413178 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.413265 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.413477 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.413564 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.413777 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.413871 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.414073 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.414160 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.414371 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.414457 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.414672 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.414772 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.414965 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.415051 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.415258 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.415344 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.415555 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.415650 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.415850 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.415939 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.416148 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.416236 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.416472 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.416579 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.416769 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.416857 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.417066 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.417160 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.417365 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.417453 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.417664 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.417752 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.417960 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.418047 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.418254 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.418348 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.418548 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.418637 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.418842 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.418929 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.419136 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.419236 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.419430 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.419517 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.419723 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.419821 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.420025 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.420114 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.420322 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.420409 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.420645 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.420732 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.420941 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.421077 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.421253 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.421340 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.421554 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.421651 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.421850 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.421938 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.422186 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.422273 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.422485 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.422583 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.422795 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.422947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.423097 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.423235 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.423373 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.423517 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.423680 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.424085 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.424220 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.424357 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.424625 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.424774 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.424913 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.425048 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.425184 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.425319 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.425464 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.425599 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.425736 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.425872 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.426018 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.426160 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.426311 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.426446 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.426588 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.426725 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.426883 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.427021 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.427293 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.427934 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.428063 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.428150 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.428371 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.428476 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.428700 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.428790 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.429006 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.429148 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.429301 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.429444 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.429603 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.429740 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.429905 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.430037 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.430211 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.430355 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.430503 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.430646 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.430785 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.430929 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.431087 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.431235 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.431387 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.431518 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.431686 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.431818 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.431987 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.432128 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.432274 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.432404 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.432595 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.432709 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.432887 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.433030 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.433172 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.433307 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.433448 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.433583 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.433760 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.433895 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.434055 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.434202 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.434338 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.434471 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.434626 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.434759 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.434922 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.435066 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.435211 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.435345 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.435508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.435645 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.435916 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.436053 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.436220 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.436365 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.436546 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.436687 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.436846 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.436982 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.437149 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.437296 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.437432 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.437567 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.437746 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.437888 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.438036 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.438181 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.438319 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.438463 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.438706 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.438842 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.439003 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.439150 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.439284 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.439422 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.439592 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.439724 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.439885 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.440027 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.440187 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.440321 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.440513 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.440648 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.440799 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.440934 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.441112 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.441261 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.441394 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.441530 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.441676 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.441819 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.441972 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.442108 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.442273 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.442404 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.442588 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.442720 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.443052 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.443192 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.443359 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.443501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.443659 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.443792 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.443998 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.444139 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.444313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.444512 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.444686 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.444823 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.444959 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.445095 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.445230 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.445375 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.445535 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.445685 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.445821 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.445967 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.446137 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.446275 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.446438 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.446582 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.446743 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.446880 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.447041 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.447186 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.447348 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.447493 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.447654 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.447792 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.447939 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.448073 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.448252 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.448398 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.448591 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.448724 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.448899 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.449041 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.449199 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.449333 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.449569 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.449700 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.449889 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.450031 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.450197 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.450334 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.450497 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.450628 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.450802 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.450934 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.451080 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.451216 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.451378 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.451524 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.451657 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.451810 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.451951 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.452083 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.452237 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.452369 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.452579 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.452725 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.452862 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.453012 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.453145 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.453280 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.453445 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.453585 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.453753 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.453890 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.454041 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.454181 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.454335 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.454480 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.454644 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.454790 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.454923 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.455071 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.455239 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.455383 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.455543 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.455691 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.455854 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.455998 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.456146 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.456284 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.456455 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.456592 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.456770 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.456907 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.457076 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.457209 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.457372 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.457510 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.457659 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.457795 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.457944 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.458081 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.458271 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.458404 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.459098 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.459199 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.459415 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.459549 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.459738 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.459879 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.460058 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.460200 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.460362 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.460528 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.460704 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.460843 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.461024 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.461164 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.461325 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.461474 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.461607 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.461744 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.461913 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.462063 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.462210 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.462348 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.462485 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.462629 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.462773 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.462919 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.463080 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.463217 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.463374 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.463467 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.463668 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.463767 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.463963 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.464060 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.464257 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.464345 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.464575 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.464683 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.464873 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.464977 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.465180 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.465268 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.465475 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.465572 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.465774 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.465861 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.466070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.466167 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.466364 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.466452 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.466662 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.466751 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.466957 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.467097 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.467290 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.467379 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.467587 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.467683 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.467913 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.468016 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.468216 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.468303 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.468553 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.468645 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.468866 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.468967 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.469169 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.469284 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.469479 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.469576 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.469787 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.469876 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.470093 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.470181 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.470400 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.470489 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.470712 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.470801 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.471016 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.471112 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.471323 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.471417 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.471632 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.471728 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.471930 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.472018 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.472239 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.472449 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.472574 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.472782 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.472871 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.473095 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.473384 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.473530 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.473696 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.473844 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.473991 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.474165 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.474845 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.475137 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.475280 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.475418 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.475552 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.475689 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.475823 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.475966 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.476102 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.476238 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.476388 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.476547 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.476685 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.476828 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.476963 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.477100 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.477277 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.477417 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.477594 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.477734 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.477904 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.478041 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.478216 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.478365 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.478529 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.478668 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.478840 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.478975 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.479149 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.479301 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.479456 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.479589 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.479754 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.479892 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.480049 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.480199 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.480362 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.480520 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.480696 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.480828 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.481002 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.481148 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.481292 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.481427 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.481604 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.481737 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.481893 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.482028 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.482196 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.482336 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.482505 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.482651 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.482795 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.482931 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.483098 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.483236 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.483408 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.483551 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.483717 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.483856 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.484027 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.484176 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.484338 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.484531 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.484667 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.484804 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.484984 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.485169 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.485303 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.485480 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.485629 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.485805 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.486090 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.486228 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.486402 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.486541 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.486721 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.486858 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.487030 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.487176 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.487347 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.487491 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.487635 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.487786 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.487916 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.488059 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.488226 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.488367 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.488524 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.488659 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.488807 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.488943 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.489118 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.489256 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.489421 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.489512 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.489742 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.489893 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.490056 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.490187 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.490356 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.490493 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.490660 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.490891 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.491030 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.491236 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.491375 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.491552 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.491780 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.491927 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.492125 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.492263 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.492465 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.492612 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.492792 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.492942 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.493112 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.493255 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.493415 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.493555 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.493703 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.493851 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.493998 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.494134 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.494291 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.494428 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.494573 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.494710 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.494873 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.495011 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.495180 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.495324 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.495477 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.495565 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.495774 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.495860 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.496077 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.496165 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.496377 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.496498 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.496701 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.496796 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.497006 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.497102 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.497303 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.497390 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.497600 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.497686 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.497906 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.498001 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.498207 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.498294 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.498506 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.498591 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.498805 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.498901 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.499104 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.499191 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.499405 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.499492 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.499699 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.499793 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.499995 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.500080 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.500288 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.500373 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.500618 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.500709 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.500914 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.501001 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.501210 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.501314 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.501516 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.501605 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.501814 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.501901 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.502115 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.502203 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.502424 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.502512 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.502734 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.502820 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.503039 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.503135 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.503338 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.503431 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.503646 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.503732 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.503947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.504042 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.504264 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.504352 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.504686 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.504904 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.505120 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.505244 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.505471 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.505570 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.505788 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.506088 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.506184 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.506417 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.506506 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.506717 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.506803 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.507017 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.507113 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.507315 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.507403 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.507989 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.508089 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.508089 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.508246 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.508326 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.508404 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.508522 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.508601 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.508823 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.508913 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.509125 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.509211 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.509425 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.509519 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.509726 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.509813 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.510026 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.510112 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.510324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.510418 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.510630 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.510717 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.510928 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.511014 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.511227 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.511320 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.511524 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.511610 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.511823 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.511911 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.512124 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.512224 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.512423 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.512546 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.512749 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.512838 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.513074 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.513161 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.513386 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.513471 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.513691 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.513779 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.513996 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.514085 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.514300 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.514387 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.514602 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.514695 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.514908 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.515003 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.515212 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.515299 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.515515 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.515603 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.515816 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.515903 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.516138 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.516233 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.516479 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.516587 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.516772 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.516872 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.517141 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.517227 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.517446 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.517543 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.517761 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.517848 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.518076 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.518162 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.518377 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.518475 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.518690 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.518777 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.518995 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.519083 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.519298 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.519393 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.519611 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.519706 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.519916 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.520003 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.520238 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.520325 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.520569 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.520660 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.520870 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.521473 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.521684 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.521780 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.521986 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.522119 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.522292 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.522388 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.522591 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.522679 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.522884 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.522977 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.523181 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.523282 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.523482 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.523569 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.523776 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.523865 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.524073 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.524168 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.524368 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.524499 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.524686 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.524773 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.524985 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.525144 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.525277 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.525363 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.525571 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.525658 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.525863 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.525951 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.526156 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.526243 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.526450 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.526543 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.526740 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.526827 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.527034 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.527119 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.527326 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.527420 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.527619 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.527706 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.527910 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.527995 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.528204 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.528290 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.528514 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.528605 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.528811 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.528897 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.529110 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.529209 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.529407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.529496 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.529731 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.529826 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.530031 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.530125 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.530344 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.530430 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.530644 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.530730 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.530945 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.531040 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.531262 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.531349 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.531562 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.531649 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.531860 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.531947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.532174 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.532260 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.532497 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.532586 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.532802 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.532891 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.533101 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.533188 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.533402 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.533489 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.533704 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.533838 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.534004 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.534091 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.534308 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.534405 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.534611 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.534708 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.534907 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.534993 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.535223 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.535317 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.535530 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.535623 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.535831 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.535918 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.536139 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.536234 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.536450 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.536540 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.537320 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.537415 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.537623 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.537723 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.537927 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.538023 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.538228 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.538323 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.538532 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.538621 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.538835 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.538922 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.539139 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.539232 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.539438 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.539526 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.539740 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.539834 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.540046 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.540140 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.540348 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.540457 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.540687 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.540774 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.540998 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.541103 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.541302 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.541387 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.541618 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.541704 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.541934 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.542035 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.542238 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.542324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.542559 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.542645 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.542879 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.542976 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.543195 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.543282 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.543504 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.543599 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.543809 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.543951 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.544108 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.544204 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.544348 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 17:40:23.544475 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.544759 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.545062 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:40:23.545301 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 17:40:23.606190 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO dbcounter [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Registered counter for database nova_api Jul 20 17:40:23.606804 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO dbcounter [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Registered counter for database nova_api Jul 20 17:40:23.718397 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:40:23.720922 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_db.sqlalchemy.engines [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:40:23.724861 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writer thread running {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:40:23.727753 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writer thread running {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:40:23.780177 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.context [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),397f007f-3d37-459b-b899-f40f0f346dd0(cell1) {{(pid=110306) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 17:40:23.782366 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.context [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),397f007f-3d37-459b-b899-f40f0f346dd0(cell1) {{(pid=110305) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 17:40:23.784100 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG oslo_concurrency.lockutils [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:40:23.785688 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG oslo_concurrency.lockutils [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:40:23.786262 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:40:23.786465 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG oslo_concurrency.lockutils [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:40:23.787915 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:40:23.788659 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG oslo_concurrency.lockutils [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:40:23.788760 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:40:23.790612 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO dbcounter [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Registered counter for database nova_cell0 Jul 20 17:40:23.790838 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:40:23.792916 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO dbcounter [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Registered counter for database nova_cell0 Jul 20 17:40:23.794398 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO dbcounter [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Registered counter for database nova_cell1 Jul 20 17:40:23.796750 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO dbcounter [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Registered counter for database nova_cell1 Jul 20 17:40:23.803901 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:40:23.806287 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_db.sqlalchemy.engines [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:40:23.807996 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_db.sqlalchemy.engines [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:40:23.808350 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:40:23.813963 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writer thread running {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:40:23.815517 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writer thread running {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:40:23.816131 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writer thread running {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:40:23.816838 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writer thread running {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:40:23.964018 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO dbcounter [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Registered counter for database nova_cell0 Jul 20 17:40:23.968588 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO dbcounter [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Registered counter for database nova_cell0 Jul 20 17:40:23.972779 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_db.sqlalchemy.engines [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:40:23.975205 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:40:23.977211 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writer thread running {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:40:23.979575 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writer thread running {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:40:24.425620 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: WARNING keystonemiddleware.auth_token [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 17:40:24.432924 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: WARNING keystonemiddleware.auth_token [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 17:40:24.459783 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: WARNING keystonemiddleware.auth_token [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 17:40:24.467121 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: WARNING keystonemiddleware.auth_token [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 17:40:24.783272 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: WARNING keystonemiddleware.auth_token [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 17:40:24.789225 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: WARNING keystonemiddleware.auth_token [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 17:40:24.794460 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561a119029c0 pid: 110305 (default app) Jul 20 17:40:24.796547 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:40:24.797722 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jul 20 17:40:24.798146 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Jul 20 17:40:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:40:24.811451 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: WARNING keystonemiddleware.auth_token [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 17:40:24.817405 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: WARNING keystonemiddleware.auth_token [None req-bd2a53dc-9f3c-4ce2-adbc-a66147853a05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 17:40:24.823151 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561a119029c0 pid: 110306 (default app) Jul 20 17:41:45.337193 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:41:45.338222 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jul 20 17:41:45.338804 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:41:45.351836 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writing DB stats nova_api:SELECT=3 {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:41:45.352970 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writing DB stats nova_cell0:SELECT=3 {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:41:45.353858 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writing DB stats nova_cell1:SELECT=3 {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:41:45.354576 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:41:46.197413 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-e4363c2d-c18e-488c-a701-69547031f28b admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:41:46.229311 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-e4363c2d-c18e-488c-a701-69547031f28b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.883653 Jul 20 17:41:46.236505 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jul 20 17:41:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:41:48.502175 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:41:48.503695 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-e77286d8-93b2-4be8-a2ca-d693026f6ed1 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001918 Jul 20 17:41:48.504091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:41:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:41:48.947892 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-2937a655-3962-4fbb-9c2e-03355ac28f6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:41:48.967401 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:41:48.967401 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: warnings.warn(msg) Jul 20 17:41:49.078963 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-2937a655-3962-4fbb-9c2e-03355ac28f6a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.567680 Jul 20 17:41:49.079815 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:41:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:41:49.312735 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-2f9a1c3d-1bc7-4a3b-85fd-f6a2ddf41a44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:41:49.315177 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:41:49.315177 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: warnings.warn(msg) Jul 20 17:41:49.317798 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_api:SELECT=3 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:41:49.318620 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_cell0:SELECT=3 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:41:49.319828 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_cell1:SELECT=3 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:41:49.320538 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:41:49.484542 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-2f9a1c3d-1bc7-4a3b-85fd-f6a2ddf41a44 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.395873 Jul 20 17:41:49.485456 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jul 20 17:41:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:41:51.790038 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-2937a655-3962-4fbb-9c2e-03355ac28f6a admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:41:51.791063 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-2937a655-3962-4fbb-9c2e-03355ac28f6a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 20 17:41:51.791460 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:41:52.438680 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-cbe3157f-26d4-4cc6-972a-e24eeea9a2ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:41:52.456873 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:41:52.456873 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: warnings.warn(msg) Jul 20 17:41:52.578921 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-cbe3157f-26d4-4cc6-972a-e24eeea9a2ef admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.781524 Jul 20 17:41:52.579928 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:41:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:41:52.591980 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-9e144630-09c5-453f-b03f-71dc424e5b1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:41:52.593701 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:41:52.593701 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: warnings.warn(msg) Jul 20 17:41:52.788454 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-9e144630-09c5-453f-b03f-71dc424e5b1e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.199188 Jul 20 17:41:52.789658 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jul 20 17:41:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:41:55.024207 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-cbe3157f-26d4-4cc6-972a-e24eeea9a2ef admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:41:55.025287 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-cbe3157f-26d4-4cc6-972a-e24eeea9a2ef admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Jul 20 17:41:55.025683 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:41:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:41:55.419372 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-fe936360-55c9-4e79-8cd4-c64d02c2d28e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:41:55.509304 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-fe936360-55c9-4e79-8cd4-c64d02c2d28e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477472 Jul 20 17:41:55.509890 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:41:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 17:41:55.521622 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-c4b39fe2-a945-45c2-bd8e-e04045eb697b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:41:55.609856 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-c4b39fe2-a945-45c2-bd8e-e04045eb697b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091861 Jul 20 17:41:55.610432 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jul 20 17:41:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:41:57.849415 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-fe936360-55c9-4e79-8cd4-c64d02c2d28e admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:41:57.850480 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-fe936360-55c9-4e79-8cd4-c64d02c2d28e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 20 17:41:57.850876 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:41:58.328807 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-7e04cc45-297d-4b67-9378-da0affc527a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "name": "ds2G", "id": "d3", "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:41:58.436240 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-7e04cc45-297d-4b67-9378-da0affc527a1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.579583 Jul 20 17:41:58.437219 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:41:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:41:58.448690 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-ccd17e2d-3d9f-4155-b972-be4dbe888b8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:41:58.554159 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-ccd17e2d-3d9f-4155-b972-be4dbe888b8b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108306 Jul 20 17:41:58.554692 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jul 20 17:41:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:42:00.782429 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-7e04cc45-297d-4b67-9378-da0affc527a1 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:00.783431 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-7e04cc45-297d-4b67-9378-da0affc527a1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 20 17:42:00.783829 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:01.221375 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-33d12428-aff2-4b71-8f3f-8913141f51f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:01.355164 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-33d12428-aff2-4b71-8f3f-8913141f51f1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.564669 Jul 20 17:42:01.355863 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:42:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:42:01.367917 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-fd35a596-af94-4add-8b0c-6ef4ba8a0640 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:01.518406 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-fd35a596-af94-4add-8b0c-6ef4ba8a0640 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.152473 Jul 20 17:42:01.518406 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jul 20 17:42:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:42:03.831541 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-33d12428-aff2-4b71-8f3f-8913141f51f1 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:03.832646 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-33d12428-aff2-4b71-8f3f-8913141f51f1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 20 17:42:03.833064 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:04.264242 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-f627fe54-8e1c-4dba-961d-f8c978664587 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:04.287178 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-f627fe54-8e1c-4dba-961d-f8c978664587 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447789 Jul 20 17:42:04.288255 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jul 20 17:42:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:42:06.610305 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-33d12428-aff2-4b71-8f3f-8913141f51f1 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:06.611435 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-33d12428-aff2-4b71-8f3f-8913141f51f1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 20 17:42:06.611869 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:07.020130 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-e605f224-905e-42ad-a589-d7be8c7f7296 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "swap": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:07.128832 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-e605f224-905e-42ad-a589-d7be8c7f7296 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.510594 Jul 20 17:42:07.129841 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:42:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 17:42:07.142267 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-f4b343ba-9afb-4b11-9588-24e97d621347 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:07.244698 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-f4b343ba-9afb-4b11-9588-24e97d621347 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105820 Jul 20 17:42:07.245182 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jul 20 17:42:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:42:09.462564 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-e605f224-905e-42ad-a589-d7be8c7f7296 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:09.463585 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-e605f224-905e-42ad-a589-d7be8c7f7296 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 20 17:42:09.463981 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:42:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:09.870340 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-c1d3da1e-3007-48ac-8d2d-6fd32f154955 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "id": "2"}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:09.954085 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-c1d3da1e-3007-48ac-8d2d-6fd32f154955 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.484365 Jul 20 17:42:09.954746 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:42:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:42:09.967369 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-935c68a4-916c-4dcf-8c6f-4b73e3578369 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:10.237773 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-935c68a4-916c-4dcf-8c6f-4b73e3578369 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.274098 Jul 20 17:42:10.238365 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jul 20 17:42:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:42:12.484837 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-c1d3da1e-3007-48ac-8d2d-6fd32f154955 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:12.485839 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-c1d3da1e-3007-48ac-8d2d-6fd32f154955 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 20 17:42:12.486236 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:12.836573 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-1965f3b3-41b3-4bf6-85ad-2430f925cdee admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:12.915037 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-1965f3b3-41b3-4bf6-85ad-2430f925cdee admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.422971 Jul 20 17:42:12.915613 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:42:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 17:42:12.928534 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-0986a3ed-a32f-417a-bb86-e688b7adbff7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:13.016105 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-0986a3ed-a32f-417a-bb86-e688b7adbff7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092055 Jul 20 17:42:13.017129 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jul 20 17:42:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:42:15.298717 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-1965f3b3-41b3-4bf6-85ad-2430f925cdee admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:15.299949 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-1965f3b3-41b3-4bf6-85ad-2430f925cdee admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 20 17:42:15.300830 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:15.737584 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-ef486866-f1bc-43a6-82db-de06b5a27d51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "swap": 0}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:15.742361 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:42:15.828990 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-ef486866-f1bc-43a6-82db-de06b5a27d51 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.522065 Jul 20 17:42:15.829698 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:42:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:42:15.842355 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-d8e39456-e54b-4380-a944-bd31880a6972 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:15.941274 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-d8e39456-e54b-4380-a944-bd31880a6972 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102614 Jul 20 17:42:15.941939 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jul 20 17:42:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:42:18.203444 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-ef486866-f1bc-43a6-82db-de06b5a27d51 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:18.208267 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-ef486866-f1bc-43a6-82db-de06b5a27d51 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 20 17:42:18.209766 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:42:18 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:18.731784 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-f1b3b89c-3f28-4e49-b804-31181d8c53b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:18.843084 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-f1b3b89c-3f28-4e49-b804-31181d8c53b5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.626796 Jul 20 17:42:18.843695 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jul 20 17:42:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:42:18.856141 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-9f0a9691-a8f3-4d6d-8e14-1232bbe5c0f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:18.954220 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-9f0a9691-a8f3-4d6d-8e14-1232bbe5c0f2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101657 Jul 20 17:42:18.954987 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jul 20 17:42:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:42:39.345695 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-f1b3b89c-3f28-4e49-b804-31181d8c53b5 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:39.346706 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-f1b3b89c-3f28-4e49-b804-31181d8c53b5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 20 17:42:39.347125 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:39.749162 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-bd66c8a5-a50e-4f79-8436-ca7770580908 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:39.766393 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-bd66c8a5-a50e-4f79-8436-ca7770580908 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413534 Jul 20 17:42:39.766926 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jul 20 17:42:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:42:40.823580 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-f1b3b89c-3f28-4e49-b804-31181d8c53b5 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:40.824625 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-f1b3b89c-3f28-4e49-b804-31181d8c53b5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 20 17:42:40.825025 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:41.338775 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-76c7ebd0-f264-4b26-80c0-cdafc1dd4309 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:41.344310 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.wsgi [None req-76c7ebd0-f264-4b26-80c0-cdafc1dd4309 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-76c7ebd0-f264-4b26-80c0-cdafc1dd4309 admin admin] Request method failure captured: Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Accept: application/json Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Accept-Encoding: gzip, deflate Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Connection: keep-alive Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Content-Length: 0 Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Host: 10.222.0.42 Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Openstack-Api-Version: compute 2.90 Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Openstack-System-Scope: None Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: User-Agent: python-novaclient Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Auth-Token: gAAAAABi2D6Quc59qzCUnFa00BVv1pZ_DXsoqxIvQ6tK79Pa83ceBpMnL3-Lrf2BqECV8odbIAGgZvfkzOavF1p-Ta3lB7X-CQqxQUvfPv_7gQSuBajB9fFUO5_rqCRbf6fLVLC9J-QqZ7Opjo_GmH4UXRjRa0BGaqUbk2PiVpmRe5pJTHOwZZI Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Domain-Id: None Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Domain-Name: None Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Identity-Status: Confirmed Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Is-Admin-Project: True Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Domain-Id: default Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Domain-Name: Default Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Name: admin Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Role: member,admin,reader Jul 20 17:42:41.347615 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Roles: member,admin,reader Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ddf29534d9849ed9221c0b30b65b542"}]}] Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Tenant: admin Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Tenant-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Tenant-Name: admin Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User: admin Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Domain-Id: default Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Domain-Name: Default Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Id: 85af2924b4aa4547ad22ecda72bbb229 Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Name: admin Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: method: > Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: exception: Flavor 42 could not be found. Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: action_args: {'id': '42'} Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:42:41.349313 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:41.350285 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.351501 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-76c7ebd0-f264-4b26-80c0-cdafc1dd4309 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:42:41.352614 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-76c7ebd0-f264-4b26-80c0-cdafc1dd4309 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.386527 Jul 20 17:42:41.352614 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jul 20 17:42:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 17:42:41.358621 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-8e694ab2-d346-4d1f-b330-14de45517eef admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:41.361637 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:42:41.380470 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-8e694ab2-d346-4d1f-b330-14de45517eef admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025393 Jul 20 17:42:41.381010 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jul 20 17:42:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:42:41.391281 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-3a1ced0f-8689-438e-9701-81b5050b4e1d admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:41.412058 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-3a1ced0f-8689-438e-9701-81b5050b4e1d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024438 Jul 20 17:42:41.412610 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jul 20 17:42:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:42:41.421714 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-ee7a32a0-c873-455b-acd7-0e802589e1d9 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:41.427539 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.wsgi [None req-ee7a32a0-c873-455b-acd7-0e802589e1d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-ee7a32a0-c873-455b-acd7-0e802589e1d9 admin admin] Request method failure captured: Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Accept: application/json Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Accept-Encoding: gzip, deflate Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Connection: keep-alive Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Content-Length: 0 Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Host: 10.222.0.42 Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Openstack-Api-Version: compute 2.90 Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Openstack-System-Scope: None Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: User-Agent: python-novaclient Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Auth-Token: gAAAAABi2D6Quc59qzCUnFa00BVv1pZ_DXsoqxIvQ6tK79Pa83ceBpMnL3-Lrf2BqECV8odbIAGgZvfkzOavF1p-Ta3lB7X-CQqxQUvfPv_7gQSuBajB9fFUO5_rqCRbf6fLVLC9J-QqZ7Opjo_GmH4UXRjRa0BGaqUbk2PiVpmRe5pJTHOwZZI Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Domain-Id: None Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Domain-Name: None Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Identity-Status: Confirmed Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Is-Admin-Project: True Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Domain-Id: default Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Domain-Name: Default Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Name: admin Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Role: member,admin,reader Jul 20 17:42:41.430947 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Roles: member,admin,reader Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ddf29534d9849ed9221c0b30b65b542"}]}] Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Tenant: admin Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Tenant-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Tenant-Name: admin Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User: admin Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Domain-Id: default Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Domain-Name: Default Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Id: 85af2924b4aa4547ad22ecda72bbb229 Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Name: admin Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: method: > Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: exception: Flavor 42 could not be found. Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: action_args: {'id': '42'} Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:42:41.433091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:41.434269 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:41.435661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-ee7a32a0-c873-455b-acd7-0e802589e1d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:42:41.436972 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-ee7a32a0-c873-455b-acd7-0e802589e1d9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014727 Jul 20 17:42:41.436972 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jul 20 17:42:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 17:42:42.409736 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-3a1ced0f-8689-438e-9701-81b5050b4e1d admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:42.410743 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-3a1ced0f-8689-438e-9701-81b5050b4e1d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 20 17:42:42.411136 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:42.926020 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-cb537262-2c38-46e7-b990-4f04ccd89f20 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:42.932728 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.wsgi [None req-cb537262-2c38-46e7-b990-4f04ccd89f20 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-cb537262-2c38-46e7-b990-4f04ccd89f20 admin admin] Request method failure captured: Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Accept: application/json Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Accept-Encoding: gzip, deflate Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Connection: keep-alive Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Content-Length: 0 Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Host: 10.222.0.42 Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Openstack-Api-Version: compute 2.90 Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Openstack-System-Scope: None Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: User-Agent: python-novaclient Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Auth-Token: gAAAAABi2D6S1m_lNgaMGs6mz9bx8B63azonwjG5h3phDYJdEeDwU_XuUA50KfuiO6dTv96pCvp42HagJvppbR4KZnYPx5KQx6w3UPMpKLuCSn89ZK_cXCU-jddhQw0Oa7h7FS10MiVMi46QuwFWinELNF1ZdBstF0Y1NsP2Q8EKsLcbWXvqs4Q Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Domain-Id: None Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Domain-Name: None Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Identity-Status: Confirmed Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Is-Admin-Project: True Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Domain-Id: default Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Domain-Name: Default Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Name: admin Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Role: member,admin,reader Jul 20 17:42:42.934246 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Roles: member,admin,reader Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ddf29534d9849ed9221c0b30b65b542"}]}] Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Tenant: admin Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Tenant-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Tenant-Name: admin Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User: admin Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Domain-Id: default Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Domain-Name: Default Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Id: 85af2924b4aa4547ad22ecda72bbb229 Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Name: admin Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: method: > Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: exception: Flavor 84 could not be found. Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: action_args: {'id': '84'} Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:42:42.935816 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:42.936948 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:42.938163 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-cb537262-2c38-46e7-b990-4f04ccd89f20 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:42:42.939258 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-cb537262-2c38-46e7-b990-4f04ccd89f20 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387926 Jul 20 17:42:42.939258 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jul 20 17:42:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 17:42:42.945210 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-43e95fc7-9403-4332-8be7-638a530cf1bd admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:42.959365 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-43e95fc7-9403-4332-8be7-638a530cf1bd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017688 Jul 20 17:42:42.959838 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jul 20 17:42:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:42:42.969292 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-895096de-4d3a-4608-ace9-ade423af1e81 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:42.982675 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-895096de-4d3a-4608-ace9-ade423af1e81 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016980 Jul 20 17:42:42.983210 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jul 20 17:42:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:42:42.992180 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-9d7590ef-2ede-4359-aab4-9c8396ad5f3f admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:42.998045 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.wsgi [None req-9d7590ef-2ede-4359-aab4-9c8396ad5f3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-9d7590ef-2ede-4359-aab4-9c8396ad5f3f admin admin] Request method failure captured: Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Accept: application/json Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Accept-Encoding: gzip, deflate Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Connection: keep-alive Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Content-Length: 0 Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Host: 10.222.0.42 Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Openstack-Api-Version: compute 2.90 Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Openstack-System-Scope: None Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: User-Agent: python-novaclient Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Auth-Token: gAAAAABi2D6S1m_lNgaMGs6mz9bx8B63azonwjG5h3phDYJdEeDwU_XuUA50KfuiO6dTv96pCvp42HagJvppbR4KZnYPx5KQx6w3UPMpKLuCSn89ZK_cXCU-jddhQw0Oa7h7FS10MiVMi46QuwFWinELNF1ZdBstF0Y1NsP2Q8EKsLcbWXvqs4Q Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Domain-Id: None Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Domain-Name: None Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Identity-Status: Confirmed Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Is-Admin-Project: True Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Domain-Id: default Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Domain-Name: Default Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Name: admin Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Role: member,admin,reader Jul 20 17:42:42.999581 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Roles: member,admin,reader Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ddf29534d9849ed9221c0b30b65b542"}]}] Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Tenant: admin Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Tenant-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Tenant-Name: admin Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User: admin Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Domain-Id: default Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Domain-Name: Default Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Id: 85af2924b4aa4547ad22ecda72bbb229 Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Name: admin Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: method: > Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: exception: Flavor 84 could not be found. Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: action_args: {'id': '84'} Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:42:43.001232 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:43.002188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:43.003324 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-9d7590ef-2ede-4359-aab4-9c8396ad5f3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:42:43.004745 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-9d7590ef-2ede-4359-aab4-9c8396ad5f3f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012331 Jul 20 17:42:43.004745 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jul 20 17:42:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 17:42:43.957260 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-895096de-4d3a-4608-ace9-ade423af1e81 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:43.958271 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-895096de-4d3a-4608-ace9-ade423af1e81 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 20 17:42:43.958667 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:42:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:44.476383 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-b4f44bc1-c56e-4c97-b5c0-8ab3cc75074b admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:44.483100 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.wsgi [None req-b4f44bc1-c56e-4c97-b5c0-8ab3cc75074b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-b4f44bc1-c56e-4c97-b5c0-8ab3cc75074b admin admin] Request method failure captured: Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Accept: application/json Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Accept-Encoding: gzip, deflate Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Connection: keep-alive Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Content-Length: 0 Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Host: 10.222.0.42 Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Openstack-Api-Version: compute 2.90 Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Openstack-System-Scope: None Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: User-Agent: python-novaclient Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Auth-Token: gAAAAABi2D6TfHbAf19I4NciDYswMiM5hwLkuC7h3RK2OOk3lbidGinQhbHxX349Gd6kgyiHw8ASdpIkgnrT5dZdNe4actDSFlNbejqu0YIh98Re5Z1LMSb3plrvaAi_CQOxeMoZ_oO5pHjN93-znB_MoF333Z_7LIQUowATA70PaFGBLkhOHhM Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Domain-Id: None Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Domain-Name: None Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Identity-Status: Confirmed Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Is-Admin-Project: True Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Domain-Id: default Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Domain-Name: Default Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Project-Name: admin Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Role: member,admin,reader Jul 20 17:42:44.484643 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Roles: member,admin,reader Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ddf29534d9849ed9221c0b30b65b542"}]}] Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Tenant: admin Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Tenant-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-Tenant-Name: admin Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User: admin Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Domain-Id: default Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Domain-Name: Default Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Id: 85af2924b4aa4547ad22ecda72bbb229 Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: X-User-Name: admin Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: method: > Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: exception: Flavor 451 could not be found. Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: action_args: {'id': '451'} Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:42:44.486176 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:44.487070 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.488188 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-b4f44bc1-c56e-4c97-b5c0-8ab3cc75074b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:42:44.489537 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-b4f44bc1-c56e-4c97-b5c0-8ab3cc75074b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391209 Jul 20 17:42:44.489537 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jul 20 17:42:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 17:42:44.495558 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-06f9599f-d20d-4b51-bfd9-a7ba16e6fabc admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:44.508966 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-06f9599f-d20d-4b51-bfd9-a7ba16e6fabc admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016979 Jul 20 17:42:44.509481 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jul 20 17:42:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:42:44.518452 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:44.533515 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018544 Jul 20 17:42:44.534029 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jul 20 17:42:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:42:44.543677 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-632576ea-cfd7-4454-a0d4-bf9794d63f38 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:44.549006 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.wsgi [None req-632576ea-cfd7-4454-a0d4-bf9794d63f38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-632576ea-cfd7-4454-a0d4-bf9794d63f38 admin admin] Request method failure captured: Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Accept: application/json Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Accept-Encoding: gzip, deflate Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Connection: keep-alive Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Content-Length: 0 Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Host: 10.222.0.42 Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Openstack-Api-Version: compute 2.90 Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Openstack-System-Scope: None Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: User-Agent: python-novaclient Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Auth-Token: gAAAAABi2D6TfHbAf19I4NciDYswMiM5hwLkuC7h3RK2OOk3lbidGinQhbHxX349Gd6kgyiHw8ASdpIkgnrT5dZdNe4actDSFlNbejqu0YIh98Re5Z1LMSb3plrvaAi_CQOxeMoZ_oO5pHjN93-znB_MoF333Z_7LIQUowATA70PaFGBLkhOHhM Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Domain-Id: None Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Domain-Name: None Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Identity-Status: Confirmed Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Is-Admin-Project: True Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Domain-Id: default Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Domain-Name: Default Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Project-Name: admin Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Role: member,admin,reader Jul 20 17:42:44.550508 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Roles: member,admin,reader Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3ddf29534d9849ed9221c0b30b65b542"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3ddf29534d9849ed9221c0b30b65b542"}]}] Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Tenant: admin Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Tenant-Id: 3ddf29534d9849ed9221c0b30b65b542 Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-Tenant-Name: admin Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User: admin Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Domain-Id: default Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Domain-Name: Default Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Id: 85af2924b4aa4547ad22ecda72bbb229 Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: X-User-Name: admin Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: method: > Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: exception: Flavor 451 could not be found. Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: action_args: {'id': '451'} Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:42:44.552398 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:44.553407 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: ERROR nova.api.openstack.wsgi Jul 20 17:42:44.554711 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-632576ea-cfd7-4454-a0d4-bf9794d63f38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:42:44.555951 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-632576ea-cfd7-4454-a0d4-bf9794d63f38 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012370 Jul 20 17:42:44.555951 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jul 20 17:42:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 17:42:45.503162 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:45.504175 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 20 17:42:45.504674 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:46.026400 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-538dcc4b-6d66-4d5e-8c3a-af40c7da152f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:46.118127 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-538dcc4b-6d66-4d5e-8c3a-af40c7da152f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.469507 Jul 20 17:42:46.118673 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jul 20 17:42:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 17:42:47.087150 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:47.088187 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 20 17:42:47.088614 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:47.601828 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-28191339-88e2-4400-b1a1-506e20fdfde8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:47.730641 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-28191339-88e2-4400-b1a1-506e20fdfde8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.505317 Jul 20 17:42:47.731192 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jul 20 17:42:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:42:48.708356 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:48.709395 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 20 17:42:48.709781 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:49.224105 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-715b5a9f-6ae2-4314-a8d0-7c6929da37b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:49.313802 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-715b5a9f-6ae2-4314-a8d0-7c6929da37b0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.467556 Jul 20 17:42:49.314343 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jul 20 17:42:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:42:50.281838 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:50.282841 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 20 17:42:50.283252 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:50.806226 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-03fb8eb1-9fe6-43f1-9ddd-9f29c68597f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:42:50.891123 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-03fb8eb1-9fe6-43f1-9ddd-9f29c68597f3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.470036 Jul 20 17:42:50.891661 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jul 20 17:42:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:42:51.862272 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:51.863269 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jul 20 17:42:51.863658 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:42:52.377043 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-ce41858c-28de-4b99-ab89-8886df4e1675 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:42:52.395672 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-ce41858c-28de-4b99-ab89-8886df4e1675 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.395649 Jul 20 17:42:52.396201 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Jul 20 17:42:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:43:43.851388 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:43:43.852382 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-97e689aa-1c48-4c02-943d-3e141806b21f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 20 17:43:43.852800 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jul 20 17:43:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:43:43.862989 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:43:44.249070 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-56a48e0b-30d3-40c5-9b98-d43a95565973 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:43:44.267638 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-56a48e0b-30d3-40c5-9b98-d43a95565973 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409116 Jul 20 17:43:44.268091 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jul 20 17:43:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:43:44.290442 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-c4d7ff3e-6e03-44b6-9cf8-23a26d8254eb admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:43:44.293807 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG dbcounter [-] [110306] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:43:44.299160 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-c4d7ff3e-6e03-44b6-9cf8-23a26d8254eb admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012351 Jul 20 17:43:44.299670 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Wed Jul 20 17:43:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:43:44.311689 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-b1991554-cb89-4522-ba07-5d9979f6c5e4 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:43:44.319133 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-b1991554-cb89-4522-ba07-5d9979f6c5e4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011569 Jul 20 17:43:44.319634 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Wed Jul 20 17:43:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:43:44.330419 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:43:44.337645 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010612 Jul 20 17:43:44.338151 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Wed Jul 20 17:43:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:43:44.349077 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-ed3cf2a0-053d-4718-919b-68cf32e1ca57 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:43:44.359288 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-ed3cf2a0-053d-4718-919b-68cf32e1ca57 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013191 Jul 20 17:43:44.360241 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Wed Jul 20 17:43:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:47:20.996944 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:47:20.998029 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 20 17:47:20.998426 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:47:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:47:21.138050 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_api:SELECT=6 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:47:21.297214 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-50101cd6-1168-4e77-8bc7-67dabec29eb1 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:47:21.298382 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:47:21.298382 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: warnings.warn(msg) Jul 20 17:47:21.299596 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-50101cd6-1168-4e77-8bc7-67dabec29eb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:47:21.300032 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-50101cd6-1168-4e77-8bc7-67dabec29eb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:47:21.300839 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-50101cd6-1168-4e77-8bc7-67dabec29eb1 admin admin] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:47:21.301264 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-50101cd6-1168-4e77-8bc7-67dabec29eb1 admin admin] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:47:21.335565 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-50101cd6-1168-4e77-8bc7-67dabec29eb1 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199120 Jul 20 17:47:21.336105 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jul 20 17:47:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:47:22.151079 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:47:22.152152 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 20 17:47:22.152579 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:47:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:47:22.342694 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-3ec7a1e4-7ee5-4ddf-b267-2e07a331b41b admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:47:22.343879 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:47:22.343879 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: warnings.warn(msg) Jul 20 17:47:22.345062 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-3ec7a1e4-7ee5-4ddf-b267-2e07a331b41b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:47:22.345500 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-3ec7a1e4-7ee5-4ddf-b267-2e07a331b41b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:47:22.346267 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-3ec7a1e4-7ee5-4ddf-b267-2e07a331b41b admin admin] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:47:22.346690 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-3ec7a1e4-7ee5-4ddf-b267-2e07a331b41b admin admin] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:47:22.366039 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-3ec7a1e4-7ee5-4ddf-b267-2e07a331b41b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075514 Jul 20 17:47:22.366573 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jul 20 17:47:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:47:33.567778 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:47:33.568818 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 20 17:47:33.569215 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:47:33.715020 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_cell0:SELECT=4 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:47:33.715755 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_cell1:SELECT=4 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:47:33.716405 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG dbcounter [-] [110305] Writing DB stats nova_api:SELECT=8 {{(pid=110305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:47:33.764769 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-cec5358c-9dda-4078-9603-8bb9ef41f633 admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:47:33.765959 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:47:33.765959 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: warnings.warn(msg) Jul 20 17:47:33.767119 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-cec5358c-9dda-4078-9603-8bb9ef41f633 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:47:33.767575 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-cec5358c-9dda-4078-9603-8bb9ef41f633 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:47:33.768343 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-cec5358c-9dda-4078-9603-8bb9ef41f633 admin admin] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:47:33.768789 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-cec5358c-9dda-4078-9603-8bb9ef41f633 admin admin] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:47:33.793627 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-cec5358c-9dda-4078-9603-8bb9ef41f633 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082996 Jul 20 17:47:33.794102 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jul 20 17:47:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:47:34.621952 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: DEBUG nova.api.openstack.wsgi [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] Calling method '>' {{(pid=110306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:47:34.622957 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: INFO nova.api.openstack.requestlog [None req-f8c69c03-f162-414f-b769-072776372655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 20 17:47:34.623343 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: [pid: 110306|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jul 20 17:47:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:47:34.827590 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG nova.api.openstack.wsgi [None req-b04a73bd-432f-4834-82c1-d6433c81f04d admin admin] Calling method '>' {{(pid=110305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:47:34.828791 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:47:34.828791 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: warnings.warn(msg) Jul 20 17:47:34.829974 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-b04a73bd-432f-4834-82c1-d6433c81f04d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:47:34.830412 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-b04a73bd-432f-4834-82c1-d6433c81f04d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:47:34.831765 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-b04a73bd-432f-4834-82c1-d6433c81f04d admin admin] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:47:34.832241 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: DEBUG oslo_concurrency.lockutils [None req-b04a73bd-432f-4834-82c1-d6433c81f04d admin admin] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:47:34.853505 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: INFO nova.api.openstack.requestlog [None req-b04a73bd-432f-4834-82c1-d6433c81f04d admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081892 Jul 20 17:47:34.854039 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: [pid: 110305|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jul 20 17:47:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:48:31.593420 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: Wed Jul 20 17:48:31 2022 - graceful shutdown triggered... Jul 20 17:48:31.593556 dv-cinder-849846-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 17:48:31.594538 dv-cinder-849846-3-iscsi devstack@n-api.service[110306]: Gracefully killing worker 2 (pid: 110306)... Jul 20 17:48:31.594964 dv-cinder-849846-3-iscsi devstack@n-api.service[110305]: Gracefully killing worker 1 (pid: 110305)... Jul 20 17:48:32.595647 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: worker 1 buried after 1 seconds Jul 20 17:48:32.596252 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: worker 2 buried after 1 seconds Jul 20 17:48:32.596252 dv-cinder-849846-3-iscsi devstack@n-api.service[110304]: goodbye to uWSGI. Jul 20 17:48:32.597340 dv-cinder-849846-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 17:48:32.597913 dv-cinder-849846-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 17:48:32.600717 dv-cinder-849846-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 17:48:32.609984 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 17:48:32 2022] *** Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: nodename: dv-cinder-849846-3-iscsi Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: machine: x86_64 Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: clock source: unix Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: pcre jit disabled Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: detected number of CPU cores: 4 Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: current working directory: / Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: detected binary path: /usr/bin/uwsgi-core Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: your processes number limit is 47680 Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: your memory page size is 4096 bytes Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: detected max file descriptor number: 2048 Jul 20 17:48:32.612649 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: lock engine: pthread robust mutexes Jul 20 17:48:32.613597 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: thunder lock: enabled Jul 20 17:48:32.613597 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 17:48:32.613597 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 17:48:32.675090 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: Python main interpreter initialized at 0x55e667e5f9c0 Jul 20 17:48:32.675090 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: python threads support enabled Jul 20 17:48:32.675090 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: your server socket listen backlog is limited to 100 connections Jul 20 17:48:32.675090 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: your mercy for graceful operations on workers is 90 seconds Jul 20 17:48:32.675545 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 17:48:32.675545 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: *** Operational MODE: preforking *** Jul 20 17:48:32.675835 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: *** uWSGI is running in multiple interpreter mode *** Jul 20 17:48:32.675835 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: spawned uWSGI master process (pid: 124828) Jul 20 17:48:32.676054 dv-cinder-849846-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 17:48:32.677380 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: spawned uWSGI worker 1 (pid: 124845, cores: 1) Jul 20 17:48:32.677380 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: spawned uWSGI worker 2 (pid: 124846, cores: 1) Jul 20 17:48:32.677380 dv-cinder-849846-3-iscsi devstack@n-api.service[124828]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 17:48:33.338377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 17:48:33.341260 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 17:48:34.528686 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:48:34.528686 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: from cryptography.utils import int_from_bytes Jul 20 17:48:34.529368 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:48:34.529368 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: from cryptography.utils import int_from_bytes Jul 20 17:48:34.546398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:48:34.546398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: from cryptography.utils import int_from_bytes Jul 20 17:48:34.546980 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:48:34.546980 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: from cryptography.utils import int_from_bytes Jul 20 17:48:36.852620 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 17:48:36.853186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 17:48:36.853412 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 17:48:36.853737 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 17:48:36.853995 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 17:48:36.854380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.854703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.855024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.855343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.855669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.855972 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.856290 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.856639 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.865236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.865236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.865236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.865236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-3-iscsi {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.865236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.865236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.865236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.865236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.869610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.869610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.869610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.869610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.869610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.869610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-3-iscsi {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.870648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.871776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.872338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.872338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.872338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.872338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.872338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.872706 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.873302 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.873302 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.873641 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.873858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.874166 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.874474 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.874779 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.875097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.875412 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.875735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.876068 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.876386 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.876809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.877067 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.877369 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.877726 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.878024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.878334 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.878658 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.879115 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.879428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.879736 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.880045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.880372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.880732 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.881041 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.881292 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.881592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.881897 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.882213 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.882520 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.882826 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.883131 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.883430 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.883735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.884040 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.884342 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.884675 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.884980 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.885282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.885589 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.886057 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.886230 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.886548 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.886866 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.887206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.887475 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.887783 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.888107 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.888405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.888764 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.889037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.889356 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.889662 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.889966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.890286 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.890592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.890896 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.891211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.891509 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.892332 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.892710 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.893016 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.893385 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.893622 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.893926 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.894230 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.894536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.894893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.895135 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.895464 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.895748 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.896070 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.896379 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.898088 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.898088 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.898088 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.898088 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.898088 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.898862 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.898862 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.899235 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.899235 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.899518 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.899814 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.900130 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.900474 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.900797 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.901108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.901420 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.901738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.902056 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.902386 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.902769 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.903119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.903330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.903642 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.903958 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.904284 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.904637 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.905033 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.905283 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.905624 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.905936 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.906257 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.906580 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.906892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.907224 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.908068 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.908388 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.908741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.909132 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.909404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.909713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.910029 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.910328 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.910485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 17:48:36.910964 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.911138 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 17:48:36.911284 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.911427 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 17:48:36.911579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.911731 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 17:48:36.911878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.912035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 17:48:36.912181 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.912324 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.912515 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.912705 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.912888 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.913117 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.913285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.913285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.913567 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.913710 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.913910 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.914071 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.914223 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.914367 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.914518 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.914679 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.914909 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.915267 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.915433 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.915597 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.915742 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.915967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.916113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.916113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-3-iscsi {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.916386 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.916579 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.916733 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.916892 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.917044 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.917215 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.917437 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.917598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.917743 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.917901 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.918054 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.918302 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.918458 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.918610 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.918761 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.918761 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.919051 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.919235 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.919460 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.919620 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.919778 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.919923 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.920066 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.920453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.920623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.920807 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.920971 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.921116 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.921261 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.921539 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.921703 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.921916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.922069 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.922221 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.922374 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.922524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.922669 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.922828 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.922828 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.923146 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-3-iscsi {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.923378 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.923531 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.923689 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.923840 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.924014 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.924166 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.924318 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.924318 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.925493 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.925653 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.925808 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.925960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.926233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.926396 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.926557 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.926714 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.926858 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.927014 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.927158 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.927345 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.927576 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.927734 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.927888 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.928040 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.928195 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.928488 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.928643 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.928796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.928940 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.929103 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.929248 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.929461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.929695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.929852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.930038 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.930252 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.930412 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.930538 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.930538 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.930749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.930749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.930956 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.931080 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.931199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.931318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.931473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.931850 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.931963 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.932083 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.932205 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.932323 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.932464 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.932583 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.938299 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.939137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.939299 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.939447 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.939609 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.939852 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.940063 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.940229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.940375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.940555 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.940701 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.940858 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.941011 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.941183 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.941336 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.941481 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.941633 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.941809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.941966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.942158 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.942315 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.942460 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.942613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.942765 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.942909 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.943071 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.943235 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.943387 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.943629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.943788 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.943947 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.944092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.944278 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.944449 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.944613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.944759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.944912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.945057 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.945210 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.945373 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.945659 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.945877 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.946038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.946224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.946414 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.946568 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.946721 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.946873 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.947068 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.947220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.947405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.947564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.947799 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.947949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.948146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.948299 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.948522 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.948685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.948831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.949013 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.949317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.949500 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.949660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.949821 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.950065 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.950233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.950379 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.950522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.950674 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.950819 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.950969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.951232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.951390 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.951534 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.951728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.951874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.952017 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.952186 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.952338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.952497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.952658 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.952814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.952967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.953112 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.953287 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.953444 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.953827 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.954035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.954762 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.954928 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.955086 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.955238 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.955426 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.955727 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.955931 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.956089 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.956234 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.956385 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.956570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.956727 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.956887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.956887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.957162 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.957325 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.957522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.957675 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.957844 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.958085 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.958243 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.958400 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.958560 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.958706 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.958861 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.959024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.959184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.959355 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.959598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.959757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.959902 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.960066 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.960300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.960469 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.960620 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.960784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.960937 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.961083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.961241 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.961468 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.961637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.961789 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.961934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.962122 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.962311 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.962461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.962605 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.962749 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.962894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.963052 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.963198 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.963342 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.963497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.963661 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.963828 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.964067 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.964227 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.964372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.964566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.964714 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.964870 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.965025 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.965171 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.965324 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.965477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.965669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.965984 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.966179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.966348 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.966500 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.966660 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.966818 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.966980 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:48:36.967139 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.967301 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.967455 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.967606 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.967758 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.967923 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.968110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.968344 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.968525 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.968680 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.968833 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.969008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.969169 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.969329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.969492 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.969765 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.969924 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.969924 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.970358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.970518 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.970670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.970832 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.970998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.970998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.971302 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.971461 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.971757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.971928 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.972096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.972249 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.972398 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.972587 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.972740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.972902 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.973064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.973217 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.973368 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.973519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.973708 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.973874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.974044 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.974317 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.974494 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.974673 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.974833 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.974991 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.975149 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.975309 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.975460 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.975625 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.976033 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.976033 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.976303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.976416 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.987884 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.988082 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.988262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.988467 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.988698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.988854 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.989019 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.989172 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.989334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.989487 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.989646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.989841 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.990127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.990280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.990537 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.991414 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.991584 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.991747 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.991915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.992076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.992230 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.992381 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.992577 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.992741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.992741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.995642 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.995815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.995974 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.996168 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.996598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.996798 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.997064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.997232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.997393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.997553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.997733 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.997733 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.998073 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.998224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.998381 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.998596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.998862 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.999030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.999222 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.999377 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.999535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.999694 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:36.999860 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.000046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.001649 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.001818 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.001981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.002145 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.002310 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.002469 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.002630 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.002783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.002933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.003100 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.003294 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.003451 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.003602 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.003760 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.003911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.004074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.004233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.004404 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.004600 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.004753 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.004952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.005127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.005288 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.005589 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.005758 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.005919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.006125 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.006287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.007291 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.007459 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.007633 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.007633 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.007945 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.008097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.008288 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.008463 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.008621 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.008772 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.009020 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.009187 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.009349 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.009511 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.009675 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.009828 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.009989 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.010149 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.010338 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.010502 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.010662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.010933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.011224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.011388 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.011541 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.012002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.012161 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.012335 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.012526 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.012694 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.012846 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.013037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.013188 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.013352 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.013506 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.013656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.013806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.013994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.014148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.014316 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.014479 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.014639 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.014866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.015055 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.015184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.015297 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.015443 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.015590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.015787 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.015908 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.016034 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.016147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.016147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.016364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.022169 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.022282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.022389 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.022599 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.022682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.022783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.022865 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.022937 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023017 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023090 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023161 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023400 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023789 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.023939 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024023 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024102 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024240 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024309 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024388 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024493 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024569 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024638 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024708 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024864 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.024951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025045 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025130 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025500 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025668 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025751 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025846 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.025932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026016 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026191 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026281 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026378 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026471 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026647 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026730 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026819 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.026964 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027057 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027149 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027235 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027325 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027417 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027502 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027686 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027771 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027854 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.027952 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028130 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028222 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028306 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028395 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028560 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028650 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028650 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.028896 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029022 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029121 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029208 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029298 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029383 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029481 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029578 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029671 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029762 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029847 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.029930 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030011 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030107 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030192 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030275 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030450 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030849 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.030931 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031029 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031224 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031311 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031395 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031656 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031823 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.031913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.032004 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.032095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033001 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033103 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033190 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033366 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033449 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033541 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033717 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033808 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033899 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.033987 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034169 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034336 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034420 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034518 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034701 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034791 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.034968 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035157 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035325 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035416 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035500 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035597 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035765 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035855 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.035948 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036033 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036124 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036216 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036300 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036383 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036504 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036601 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036688 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036771 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036904 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.036989 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037072 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037169 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037255 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037345 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037430 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037514 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037703 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037795 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037886 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.037971 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038061 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038238 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038323 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038496 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038587 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038779 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038864 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.038956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039041 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039131 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039223 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039309 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039399 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039483 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039660 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039756 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.039943 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040211 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040607 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040796 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.040933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041118 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041208 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041307 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041498 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041679 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041846 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.041941 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042039 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042124 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042207 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042724 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.042809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043488 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043573 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043670 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043756 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043839 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.043939 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044182 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044500 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044602 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.044984 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045085 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045184 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045370 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045540 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045630 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045727 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045894 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045977 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.045977 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046134 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046134 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046344 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046438 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046529 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046621 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046713 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046897 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.046981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047142 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047234 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047403 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047486 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047650 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047650 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047830 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.047942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048510 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.048978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049495 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.049585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050439 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050760 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.050850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051165 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051556 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.051953 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052604 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.052695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.053601 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.053697 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.053697 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.053697 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.053697 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.054000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.054092 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.054092 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.054092 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.054322 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.054583 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.054683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.054900 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.055187 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.055286 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.055520 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.055837 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.055964 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.056152 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.057286 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.057400 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.057489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.057594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.057689 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.057787 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.057916 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.058059 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.058428 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.058522 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.058745 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.059045 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.059149 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.059503 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.059605 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.059929 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.060088 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.060266 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.060635 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.060762 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.060962 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.061286 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.061470 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.061611 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.061941 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.062098 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.062254 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.062565 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.062654 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.062884 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.063298 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.063412 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.064133 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.064237 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.064500 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.070116 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.070232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.070320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.070412 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.070497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.070595 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.070823 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.070922 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071009 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071093 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071185 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071361 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071454 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071547 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071639 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071731 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071816 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.071906 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.072003 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.072089 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.072182 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.072274 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.072932 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.073034 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.073121 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.073205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.073488 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.073600 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.073688 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.073772 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.073863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.073955 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074058 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074058 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074583 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074654 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074654 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074654 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.074999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075160 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075693 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075778 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075778 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.075778 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.076159 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.076528 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.076639 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.076788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.077090 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.077195 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.077456 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.077692 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.077811 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.078121 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.078250 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.078445 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.078759 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.078849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.079244 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.079401 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.079574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.079898 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.080000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.080245 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.080543 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.080651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.081053 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.081152 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.081460 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.081726 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.081841 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.082146 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.082246 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.082481 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.082752 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.082856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.083091 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.083432 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.083552 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.083720 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.083960 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.084054 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.084327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.084605 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.084713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.084970 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.085220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.085326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.085589 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.085819 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.085921 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.086263 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.086944 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.087070 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.087176 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.087176 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.087376 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.087507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.087786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.087896 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.088106 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.088202 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.088455 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.088566 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.088786 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.088896 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.089115 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.089209 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.089442 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.089543 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.089761 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.089864 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.090078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.090171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.090414 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.090562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.090720 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.090869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.091053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.091196 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.091339 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.091480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.091663 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.091829 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.091970 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.092123 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.092264 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.092412 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.092645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.092738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.092974 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.093141 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.093322 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.093476 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.093666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.093810 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.094003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.094119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.094248 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.094445 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.094558 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.095240 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.095433 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.095561 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.095763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.095897 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.096086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.096213 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.096520 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.096649 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.098581 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.099209 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.099303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.099390 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.099485 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.099581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.099673 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.099765 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.099849 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.099931 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100120 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100204 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100412 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100748 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100839 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100915 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.100915 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.101095 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.101175 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.101175 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.101326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.101405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.101405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.101541 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.101612 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.101927 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.102032 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.102230 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.102414 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.102543 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.102850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.102943 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.103157 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.103390 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.103472 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.103892 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.104009 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.104222 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.104497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.104606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.104850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.104954 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.105155 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.105462 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.105627 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.105767 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.106100 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.106181 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.106437 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.106759 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.106859 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.107082 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.107333 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.107433 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.107706 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.107811 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.108019 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.108245 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.108494 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.108842 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.108985 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.109313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.109407 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.109629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.109822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.109968 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.110310 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.110440 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.111164 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.111337 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.111480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.111795 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.111886 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.112109 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.112317 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.112423 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.112778 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.112877 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.113558 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.113558 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.113773 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.114148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.114634 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.115802 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.116016 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.116123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.116123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.116306 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.116408 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.116706 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.116796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.116796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.116936 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.117038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.117268 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.117374 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.117587 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.117779 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.117986 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.118261 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.118371 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.118618 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.118755 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.118936 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.119242 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.119349 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.119564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.119750 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.119887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.120223 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.120314 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.120578 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.120797 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.120890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.121217 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.121335 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.121549 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.121755 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.121904 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.122224 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.122322 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.122575 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.122745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.122907 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.123227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.123315 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.123547 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.123722 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.123856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.124170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 17:48:37.124365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.124959 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.125452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.126019 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.126603 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.127163 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.127719 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.128285 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.128878 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.129432 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.130014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.130577 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.131165 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.131756 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.132346 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.132754 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.133078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.133424 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.133744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.134087 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.134625 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.134807 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.135066 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.135386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.135721 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.136044 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.136361 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.136720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.137035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.137465 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.137791 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.138128 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.138471 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.138815 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.139137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.139483 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.139824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.140150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.140507 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.140846 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.141162 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.141485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.142004 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.142545 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.142997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.143485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.144067 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.144702 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.144825 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.145122 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.145469 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.145788 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.146124 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.146450 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.146774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.147092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.149639 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.149861 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.150176 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.150538 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.150880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.151220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.151569 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.151900 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.152239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.152609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.152942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.153275 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.156138 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.156614 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.156978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.157854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.158202 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.158551 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.158896 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.159239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.159847 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.160200 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.160565 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.160904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.161238 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.161691 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.162026 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.162359 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.162686 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.163015 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.163345 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.163695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.164033 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.164373 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.164863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.165095 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.165451 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.166032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.166597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.167216 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.167769 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.168288 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.168874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.169589 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.169980 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.170466 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.170973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.171481 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.172056 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.172512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.173584 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.174098 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.174608 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.175194 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.175681 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.176200 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.176956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.177244 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.177863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.178763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.179351 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.179892 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.180503 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.181031 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.181854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.182312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.182838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.183335 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.183826 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.184329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.184998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.185465 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.190365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.190365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.190365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.190365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.190365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.190365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.190365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.190365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.191147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.191147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.191459 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.191959 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.192501 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.193072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.193571 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.194080 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.194564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.195031 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.195529 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.196031 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.196571 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.197133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.197568 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.198063 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.198599 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.199105 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.199595 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.199981 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.200369 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.200721 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.201222 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.201725 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.202216 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.202716 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.203199 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.203747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.204239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.204646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.205013 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.205536 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.206085 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.206610 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.207104 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.207618 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.208173 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.208588 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.208988 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.209438 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.209944 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.210499 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.211010 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.212272 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.212613 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.212949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.213326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.213869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.214493 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.214949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.215329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.215839 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.216369 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.217055 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.217773 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.218026 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.218359 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.218686 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.219015 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.219337 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.219661 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.220528 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.220855 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.221177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.221500 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.221830 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.222201 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.222537 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.222869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.223196 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.223525 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.223847 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.224168 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.224518 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.224914 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.225167 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.225509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.225837 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.228659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.228659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.228659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.228659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.228659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.228659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.228659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.228659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.229375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.229375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.229535 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.229734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.230086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.230425 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.230758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.231072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.231386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.231702 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.232022 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.232350 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.232695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.233010 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.233319 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.233637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.233949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.234264 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.234573 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.234885 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.235201 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.236077 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.236401 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.236731 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.237042 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.237352 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.237664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.237981 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.238293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.238608 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.238918 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.239228 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.239541 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.239936 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.240220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.240569 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.240901 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.241221 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.241551 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.241873 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.242206 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.242531 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.242857 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.243173 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.243514 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.243831 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.244150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.244487 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.244810 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.245129 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.245446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.245782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.246187 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.246454 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.246762 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.247142 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.247415 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.247741 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.248061 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.248401 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.248813 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.249129 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.249447 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.249764 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.250082 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.250405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.250723 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.251075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.251400 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.251727 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.252066 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.252399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.252743 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.253075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.253407 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.253761 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.254084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.254436 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.254777 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.255101 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.255422 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.255733 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:48:37.255981 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 17:48:37.287204 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO dbcounter [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Registered counter for database nova_api Jul 20 17:48:37.309021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:48:37.316211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writer thread running {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:48:37.374149 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.context [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),397f007f-3d37-459b-b899-f40f0f346dd0(cell1) {{(pid=124846) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 17:48:37.378361 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:48:37.379927 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:48:37.380767 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:48:37.382782 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:48:37.384791 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO dbcounter [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Registered counter for database nova_cell0 Jul 20 17:48:37.388899 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO dbcounter [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Registered counter for database nova_cell1 Jul 20 17:48:37.396809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:48:37.398102 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:48:37.404629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writer thread running {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:48:37.406690 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO dbcounter [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Registered counter for database nova_api Jul 20 17:48:37.406820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writer thread running {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:48:37.427207 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_db.sqlalchemy.engines [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:48:37.434146 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writer thread running {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:48:37.499795 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.context [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),397f007f-3d37-459b-b899-f40f0f346dd0(cell1) {{(pid=124845) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 17:48:37.506803 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:48:37.508495 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:48:37.509312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:48:37.513804 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:48:37.515868 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO dbcounter [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Registered counter for database nova_cell0 Jul 20 17:48:37.522194 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO dbcounter [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Registered counter for database nova_cell1 Jul 20 17:48:37.531036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_db.sqlalchemy.engines [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:48:37.536357 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_db.sqlalchemy.engines [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:48:37.542166 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writer thread running {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:48:37.572070 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO dbcounter [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Registered counter for database nova_cell0 Jul 20 17:48:37.580357 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_db.sqlalchemy.engines [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:48:37.586022 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writer thread running {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:48:37.691061 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writer thread running {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:48:37.701393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO dbcounter [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Registered counter for database nova_cell0 Jul 20 17:48:37.708208 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_db.sqlalchemy.engines [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:48:37.712790 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writer thread running {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:48:37.908498 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: WARNING keystonemiddleware.auth_token [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 17:48:37.915516 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: WARNING keystonemiddleware.auth_token [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 17:48:38.067172 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: WARNING keystonemiddleware.auth_token [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 17:48:38.074552 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: WARNING keystonemiddleware.auth_token [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 17:48:38.263895 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: WARNING keystonemiddleware.auth_token [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 17:48:38.270443 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: WARNING keystonemiddleware.auth_token [None req-5ce36c4f-8cd9-4453-b282-151c636827c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 17:48:38.277041 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e667e5f9c0 pid: 124846 (default app) Jul 20 17:48:38.433817 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: WARNING keystonemiddleware.auth_token [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 17:48:38.439866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: WARNING keystonemiddleware.auth_token [None req-724f9a86-4ebe-4285-9421-5c26aa86c260 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 17:48:38.445988 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e667e5f9c0 pid: 124845 (default app) Jul 20 17:49:20.991095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=3 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:20.991917 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=3 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:20.993947 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=3 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:20.995579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=3 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:22.654414 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-281f5d13-481c-40d6-8325-6413247ab5b3 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Action: 'create', calling method: .version_select at 0x7f7d3f79fca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1086009026"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:24.910587 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-281f5d13-481c-40d6-8325-6413247ab5b3 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.934788 Jul 20 17:49:24.913593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1154 bytes} [Wed Jul 20 17:49:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3940 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 17:49:25.479612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-98a7c75e-c399-48a5-9db8-56e75b4da603 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f85a790>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:25.548181 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:25.550643 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:25.561447 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:25.568359 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:26.420075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-98a7c75e-c399-48a5-9db8-56e75b4da603 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10" status: 200 len: 346 microversion: 2.1 time: 1.496594 Jul 20 17:49:26.420747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:49:24 2022] GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10 => generated 346 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:26.439660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-dd99b968-3482-48ca-9970-66236c7b89c8 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Action: 'create', calling method: .version_select at 0x7f7d3f66ba60>, body: {"snapshot": {"volume_id": "d0d7b508-5a97-4d35-97cc-2a6918472d10", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1370620510"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:27.486119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-dd99b968-3482-48ca-9970-66236c7b89c8 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.054806 Jul 20 17:49:27.492845 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1161 bytes} [Wed Jul 20 17:49:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:27.504720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-10c054d6-3e14-43aa-ba6a-3113dcd6be0c tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f6aab80>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:27.581393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-10c054d6-3e14-43aa-ba6a-3113dcd6be0c tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce" status: 200 len: 287 microversion: 2.1 time: 0.087313 Jul 20 17:49:27.582141 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jul 20 17:49:27 2022] GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:27.592322 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eed5ca2d-0841-494b-a4b4-90e762a6ea82 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f66bee0>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:27.805873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-eed5ca2d-0841-494b-a4b4-90e762a6ea82 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.217051 Jul 20 17:49:27.807387 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1139 bytes} [Wed Jul 20 17:49:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:27.819219 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-617ca2e7-ba50-4b6e-b21a-10b47e4c2db1 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f6aad30>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:27.890138 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-617ca2e7-ba50-4b6e-b21a-10b47e4c2db1 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce" status: 200 len: 287 microversion: 2.1 time: 0.075837 Jul 20 17:49:27.890937 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jul 20 17:49:27 2022] GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:49:28.902190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-71ac0933-91d9-4304-8e35-383839cbe8d4 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f680820>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:29.027031 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-71ac0933-91d9-4304-8e35-383839cbe8d4 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce" status: 200 len: 287 microversion: 2.1 time: 0.128505 Jul 20 17:49:29.028193 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jul 20 17:49:28 2022] GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:30.038978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ae3566fd-4b7b-4cbb-9b24-d23bd96e3efc tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f677310>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:30.082092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ae3566fd-4b7b-4cbb-9b24-d23bd96e3efc tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce" status: 200 len: 287 microversion: 2.1 time: 0.046789 Jul 20 17:49:30.083032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jul 20 17:49:30 2022] GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:30.723615 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-32045a25-aee8-4917-9778-4d009fc53640 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'create', calling method: .version_select at 0x7f7d3f680dc0>, body: {"keypair": {"name": "tempest-keypair-1565245070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZaL8g9C24kJA7gzU11Zas3kd506U9wqWik9cvSHlNrlBQTuotecQqXkecVOUcKIxngUbLKMX2DRSZ5tOUVyl+ILAWBJ6728BC5yMjUh26J2LBsdR/vua6quidQVhUEdQ=="}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:30.851611 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-32045a25-aee8-4917-9778-4d009fc53640 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Getting quotas for project 1e0c8bf2bfe34311961a4bde7f102944. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:49:30.869879 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-32045a25-aee8-4917-9778-4d009fc53640 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Getting quotas for user 311c19d7062648f78ba4c2090c58f14d and project 1e0c8bf2bfe34311961a4bde7f102944. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:49:31.098000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4b4c6484-400b-430c-ab0c-c91a19c3f663 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f6779d0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:31.153031 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-32045a25-aee8-4917-9778-4d009fc53640 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.735754 Jul 20 17:49:31.153904 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 5/9] 10.222.0.42 () {62 vars in 1199 bytes} [Wed Jul 20 17:49:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 738 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 17:49:31.162505 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4b4c6484-400b-430c-ab0c-c91a19c3f663 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce" status: 200 len: 287 microversion: 2.1 time: 0.071492 Jul 20 17:49:31.163660 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jul 20 17:49:31 2022] GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:49:32.175341 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-46952feb-b2f2-404e-9cb2-69b1464fc217 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f655ee0>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:32.236025 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-46952feb-b2f2-404e-9cb2-69b1464fc217 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce" status: 200 len: 288 microversion: 2.1 time: 0.064965 Jul 20 17:49:32.236395 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jul 20 17:49:32 2022] GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce => generated 288 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:32.247501 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c5c8b3d9-1dc0-4da7-bfa1-b6f23dd8958d tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f67e0d0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:32.506105 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c5c8b3d9-1dc0-4da7-bfa1-b6f23dd8958d tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce" status: 202 len: 0 microversion: 2.1 time: 0.263034 Jul 20 17:49:32.507866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1253 bytes} [Wed Jul 20 17:49:32 2022] DELETE /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:49:32.518388 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6f3936f3-7820-46fa-94e8-671454618812 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f6aac10>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:32.605891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6f3936f3-7820-46fa-94e8-671454618812 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce" status: 200 len: 287 microversion: 2.1 time: 0.094099 Jul 20 17:49:32.607652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jul 20 17:49:32 2022] GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:33.252916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-67463c62-59ea-48a0-b91b-686544b72636 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: .version_select at 0x7f7d3f610550>, body: {"keypair": {"name": "tempest-keypair-1053466132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xjgqFtnfd5vFHa/QkuXXaWglfBCuHw4AT/eKBzZxotwe4YbpOAAH+5YRyjacqPx2RQkSGah0vx7kVf0BK5ZVIwViuafkBra8Bdqtpfm7y3D5LWzCr1LBow+0Y/pO9Iw=="}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:33.292100 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-67463c62-59ea-48a0-b91b-686544b72636 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for project 93918dc6b6f445d18a3ecb003524152d. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:49:33.314323 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-67463c62-59ea-48a0-b91b-686544b72636 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for user 3077a7934f9c4407a70a8790b8da9cde and project 93918dc6b6f445d18a3ecb003524152d. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:49:33.439669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-67463c62-59ea-48a0-b91b-686544b72636 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.946978 Jul 20 17:49:33.449137 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 7/14] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 17:49:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:33.623228 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-45e14849-fb71-497d-9a9a-7b1d42568156 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f67e280>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:33.694576 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-45e14849-fb71-497d-9a9a-7b1d42568156 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] HTTP exception thrown: Snapshot dbc1a98d-d459-4cf5-a15c-ec416812a6ce could not be found. Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-45e14849-fb71-497d-9a9a-7b1d42568156 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Request method failure captured: Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce HTTP/1.1 Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAgTg38MNQVVFb_KzRjqRQW1i-MQ4NSAS10srJ1t-sWfUMxBm3ZqaTfek6OJllZ5CHIEaTsmPcZbDvCqxRyhBouS5CpfPM7RbHnNZXTL7Mzsvs9sBR006rFA0rNltWpuG5k1H1epjvpxI030n3Pw0Eo0Gr0t26FWsbxd0pXrl1KwmM Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 2731e64fe89e484fa08dc52786fe4dd5 Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:49:33.699745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2731e64fe89e484fa08dc52786fe4dd5"}]}] Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 2731e64fe89e484fa08dc52786fe4dd5 Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesSnapshotsTestJSON-2076187682-project Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 5c5dba86648f44f3ad71ae095cad4afc Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2076187682-project Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Snapshot dbc1a98d-d459-4cf5-a15c-ec416812a6ce could not be found. Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'dbc1a98d-d459-4cf5-a15c-ec416812a6ce'} Jul 20 17:49:33.700854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dbc1a98d-d459-4cf5-a15c-ec416812a6ce could not be found. (HTTP 404) (Request-ID: req-ae7d957b-1eb5-4880-8216-c9ac796f54f6) Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:33.701612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:49:33.702496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dbc1a98d-d459-4cf5-a15c-ec416812a6ce could not be found. Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 17:49:33.704986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dbc1a98d-d459-4cf5-a15c-ec416812a6ce could not be found. Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dbc1a98d-d459-4cf5-a15c-ec416812a6ce could not be found. Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-45e14849-fb71-497d-9a9a-7b1d42568156 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Returning 404 to user: Snapshot dbc1a98d-d459-4cf5-a15c-ec416812a6ce could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:49:33.707491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-45e14849-fb71-497d-9a9a-7b1d42568156 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce" status: 404 len: 111 microversion: 2.1 time: 0.085658 Jul 20 17:49:33.708854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 8/15] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jul 20 17:49:33 2022] GET /compute/v2.1/os-snapshots/dbc1a98d-d459-4cf5-a15c-ec416812a6ce => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:49:33.712960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3af354ec-904d-40ec-ad76-64b110bc595a tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f6104c0>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:34.076740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3af354ec-904d-40ec-ad76-64b110bc595a tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10" status: 202 len: 0 microversion: 2.1 time: 0.369402 Jul 20 17:49:34.077316 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 17:49:33 2022] DELETE /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:49:34.091956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4d83475d-d371-4f19-914b-7735ece0cbc5 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f5d64c0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:34.186570 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4d83475d-d371-4f19-914b-7735ece0cbc5 tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10" status: 200 len: 345 microversion: 2.1 time: 0.104385 Jul 20 17:49:34.192351 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 9/17] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:49:34 2022] GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:35.200626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4280cc6a-4d3a-4b20-9b38-376f0bf39cfa tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f5d6b80>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:35.277167 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-4280cc6a-4d3a-4b20-9b38-376f0bf39cfa tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] HTTP exception thrown: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4280cc6a-4d3a-4b20-9b38-376f0bf39cfa tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Request method failure captured: Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10 HTTP/1.1 Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAgTg38MNQVVFb_KzRjqRQW1i-MQ4NSAS10srJ1t-sWfUMxBm3ZqaTfek6OJllZ5CHIEaTsmPcZbDvCqxRyhBouS5CpfPM7RbHnNZXTL7Mzsvs9sBR006rFA0rNltWpuG5k1H1epjvpxI030n3Pw0Eo0Gr0t26FWsbxd0pXrl1KwmM Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 2731e64fe89e484fa08dc52786fe4dd5 Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:49:35.281480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2731e64fe89e484fa08dc52786fe4dd5"}]}] Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 2731e64fe89e484fa08dc52786fe4dd5 Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesSnapshotsTestJSON-2076187682-project Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 5c5dba86648f44f3ad71ae095cad4afc Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2076187682-project Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'd0d7b508-5a97-4d35-97cc-2a6918472d10'} Jul 20 17:49:35.282591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. (HTTP 404) (Request-ID: req-afa318cb-4d4a-4c43-9986-935726ff5721) Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:35.283263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:49:35.284652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 17:49:35.287394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.290052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.296212 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4280cc6a-4d3a-4b20-9b38-376f0bf39cfa tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Returning 404 to user: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:49:35.298095 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4280cc6a-4d3a-4b20-9b38-376f0bf39cfa tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10" status: 404 len: 109 microversion: 2.1 time: 0.102787 Jul 20 17:49:35.304634 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 10/18] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:49:35 2022] GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:49:35.311136 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-45579491-2ea1-4231-8d54-a2e4e78442cc tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f5d6550>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:35.363377 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-45579491-2ea1-4231-8d54-a2e4e78442cc tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] HTTP exception thrown: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-45579491-2ea1-4231-8d54-a2e4e78442cc tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Request method failure captured: Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: DELETE /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10 HTTP/1.1 Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAgTg38MNQVVFb_KzRjqRQW1i-MQ4NSAS10srJ1t-sWfUMxBm3ZqaTfek6OJllZ5CHIEaTsmPcZbDvCqxRyhBouS5CpfPM7RbHnNZXTL7Mzsvs9sBR006rFA0rNltWpuG5k1H1epjvpxI030n3Pw0Eo0Gr0t26FWsbxd0pXrl1KwmM Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 2731e64fe89e484fa08dc52786fe4dd5 Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:49:35.366827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2731e64fe89e484fa08dc52786fe4dd5"}]}] Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 2731e64fe89e484fa08dc52786fe4dd5 Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesSnapshotsTestJSON-2076187682-project Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 5c5dba86648f44f3ad71ae095cad4afc Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2076187682-project Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'd0d7b508-5a97-4d35-97cc-2a6918472d10'} Jul 20 17:49:35.367860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. (HTTP 404) (Request-ID: req-f763674b-a7bf-498b-bfbd-9d06f66aa4e7) Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:35.368519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 17:49:35.369562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 17:49:35.370492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.371418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.373947 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-45579491-2ea1-4231-8d54-a2e4e78442cc tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Returning 404 to user: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:49:35.374866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-45579491-2ea1-4231-8d54-a2e4e78442cc tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10" status: 404 len: 109 microversion: 2.1 time: 0.068019 Jul 20 17:49:35.375411 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 11/19] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 17:49:35 2022] DELETE /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:49:35.379925 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-721560475", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "networks": [{"uuid": "3b8677a3-30cb-4579-88a9-f44f8fc205f2"}]}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:35.384105 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-90b7916b-06b1-4ed3-a710-2665658f240f tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Calling method '.version_select at 0x7f7d3f5d6d30>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:35.425791 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-90b7916b-06b1-4ed3-a710-2665658f240f tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] HTTP exception thrown: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-90b7916b-06b1-4ed3-a710-2665658f240f tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Request method failure captured: Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10 HTTP/1.1 Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAgTg38MNQVVFb_KzRjqRQW1i-MQ4NSAS10srJ1t-sWfUMxBm3ZqaTfek6OJllZ5CHIEaTsmPcZbDvCqxRyhBouS5CpfPM7RbHnNZXTL7Mzsvs9sBR006rFA0rNltWpuG5k1H1epjvpxI030n3Pw0Eo0Gr0t26FWsbxd0pXrl1KwmM Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 2731e64fe89e484fa08dc52786fe4dd5 Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:49:35.429127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2731e64fe89e484fa08dc52786fe4dd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2731e64fe89e484fa08dc52786fe4dd5"}]}] Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 2731e64fe89e484fa08dc52786fe4dd5 Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2076187682 Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesSnapshotsTestJSON-2076187682-project Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 5c5dba86648f44f3ad71ae095cad4afc Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2076187682-project Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'd0d7b508-5a97-4d35-97cc-2a6918472d10'} Jul 20 17:49:35.430224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. (HTTP 404) (Request-ID: req-7fa442ee-7d0d-43f0-a2a0-9b6277699708) Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:35.430876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:49:35.431827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 17:49:35.436662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-90b7916b-06b1-4ed3-a710-2665658f240f tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] Returning 404 to user: Volume d0d7b508-5a97-4d35-97cc-2a6918472d10 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-90b7916b-06b1-4ed3-a710-2665658f240f tempest-VolumesSnapshotsTestJSON-2076187682 tempest-VolumesSnapshotsTestJSON-2076187682-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10" status: 404 len: 109 microversion: 2.1 time: 0.055130 Jul 20 17:49:35.438462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 12/20] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:49:35 2022] GET /compute/v2.1/os-volumes/d0d7b508-5a97-4d35-97cc-2a6918472d10 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:49:35.572136 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] validate_networks() for [('3b8677a3-30cb-4579-88a9-f44f8fc205f2', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:49:38.518589 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:49:38.520077 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:49:38.520753 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:49:38.521446 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:49:38.522300 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:49:38.545748 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:38.548697 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:38.553707 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:38.554461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:38.595055 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Getting quotas for project 6a76562649474d5bb8f326aab70630ab. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:49:38.599276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Getting quotas for user 137e21587db048529f771d750da5b208 and project 6a76562649474d5bb8f326aab70630ab. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:49:38.612352 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:49:38.614850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:49:38.828862 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-607b7a14-f0dc-42fb-b054-696ae81d7ae8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.866643 Jul 20 17:49:38.834932 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 9/21] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:49:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:49:38.851104 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f634e4a9-eced-46eb-a4e5-c3efb613bd98 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:38.853295 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f634e4a9-eced-46eb-a4e5-c3efb613bd98 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:38.907128 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1265553860", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4543ca71-03de-461e-8540-7f258ee4032c"}], "security_groups": [{"name": "tempest-securitygroup--1767842353"}], "key_name": "tempest-keypair-1565245070", "user_data": "}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:39.127353 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f634e4a9-eced-46eb-a4e5-c3efb613bd98 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:39.170386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f634e4a9-eced-46eb-a4e5-c3efb613bd98 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1214 microversion: 2.1 time: 0.334121 Jul 20 17:49:39.170912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 13/22] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:38 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:39.217706 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] validate_networks() for [('4543ca71-03de-461e-8540-7f258ee4032c', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:49:40.196754 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-03512396-9510-429d-8347-dbf397768ab9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:40.198900 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-03512396-9510-429d-8347-dbf397768ab9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:40.213220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:49:40.214438 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:49:40.215100 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:49:40.215875 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:49:40.216704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:49:40.250301 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:40.255379 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:40.256629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:40.259175 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:40.342064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Getting quotas for project 1e0c8bf2bfe34311961a4bde7f102944. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:49:40.347655 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Getting quotas for user 311c19d7062648f78ba4c2090c58f14d and project 1e0c8bf2bfe34311961a4bde7f102944. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:49:40.372576 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-03512396-9510-429d-8347-dbf397768ab9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:40.381294 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:49:40.382473 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-03512396-9510-429d-8347-dbf397768ab9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1214 microversion: 2.1 time: 0.190569 Jul 20 17:49:40.383277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 14/23] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:40 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:40.396343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:49:40.420367 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-910558428", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e772fe92-4472-4af3-b6e9-3d6e16e3740d"}], "security_groups": [{"name": "tempest-securitygroup--1981311903"}], "key_name": "tempest-keypair-1053466132", "user_data": "}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:40.666902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e3cc2838-25a9-4710-9ae0-3ac9f725cab0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.757602 Jul 20 17:49:40.666902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 10/24] 10.222.0.42 () {62 vars in 1187 bytes} [Wed Jul 20 17:49:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 17:49:40.675659 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3ab8d00e-3767-4fd3-b0bb-a21369c8ba2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:40.676285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3ab8d00e-3767-4fd3-b0bb-a21369c8ba2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:40.700574 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] validate_networks() for [('e772fe92-4472-4af3-b6e9-3d6e16e3740d', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:49:40.979829 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3ab8d00e-3767-4fd3-b0bb-a21369c8ba2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:41.012385 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3ab8d00e-3767-4fd3-b0bb-a21369c8ba2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:41.014117 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3ab8d00e-3767-4fd3-b0bb-a21369c8ba2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:41.022676 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3ab8d00e-3767-4fd3-b0bb-a21369c8ba2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1282 microversion: 2.20 time: 0.346109 Jul 20 17:49:41.025878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 11/25] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:40 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1282 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:41.399621 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-737bca04-ae70-4af6-90e3-e46a6ce51cad tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:41.400289 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-737bca04-ae70-4af6-90e3-e46a6ce51cad tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:41.470884 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-737bca04-ae70-4af6-90e3-e46a6ce51cad tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:41.480239 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-737bca04-ae70-4af6-90e3-e46a6ce51cad tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1214 microversion: 2.1 time: 0.084725 Jul 20 17:49:41.482297 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:41 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:42.048749 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b2807c34-0c16-43c4-b81d-4aad281a1f58 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:42.049595 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b2807c34-0c16-43c4-b81d-4aad281a1f58 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:42.103047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:49:42.104268 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:49:42.104972 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:49:42.105597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:49:42.106133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:49:42.131616 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:42.133148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:42.136416 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:42.138017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:42.140356 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b2807c34-0c16-43c4-b81d-4aad281a1f58 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:42.148727 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b2807c34-0c16-43c4-b81d-4aad281a1f58 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:42.151080 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b2807c34-0c16-43c4-b81d-4aad281a1f58 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:42.152199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b2807c34-0c16-43c4-b81d-4aad281a1f58 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1282 microversion: 2.20 time: 0.108435 Jul 20 17:49:42.152819 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 13/27] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:42 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:42.170488 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for project 93918dc6b6f445d18a3ecb003524152d. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:49:42.178128 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for user 3077a7934f9c4407a70a8790b8da9cde and project 93918dc6b6f445d18a3ecb003524152d. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:49:42.193730 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:49:42.194715 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:49:42.370140 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3876f709-a9fb-45ff-af25-58c8e45aae4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.974519 Jul 20 17:49:42.377025 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 15/28] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:49:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:49:42.382533 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-51c0743c-9142-4541-8b48-45d567421bcc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:42.383244 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-51c0743c-9142-4541-8b48-45d567421bcc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:42.498308 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6cbfa632-50ae-49f6-96f3-b8c9dcb8122d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:42.500479 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6cbfa632-50ae-49f6-96f3-b8c9dcb8122d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:42.514640 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6cbfa632-50ae-49f6-96f3-b8c9dcb8122d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:42.517039 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6cbfa632-50ae-49f6-96f3-b8c9dcb8122d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:42.518247 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6cbfa632-50ae-49f6-96f3-b8c9dcb8122d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:42.521330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-51c0743c-9142-4541-8b48-45d567421bcc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:42.522209 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6cbfa632-50ae-49f6-96f3-b8c9dcb8122d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:42.529602 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-51c0743c-9142-4541-8b48-45d567421bcc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1241 microversion: 2.1 time: 0.150820 Jul 20 17:49:42.539917 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 14/29] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:42 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:42.747403 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6cbfa632-50ae-49f6-96f3-b8c9dcb8122d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:42.759767 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6cbfa632-50ae-49f6-96f3-b8c9dcb8122d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1218 microversion: 2.1 time: 0.265501 Jul 20 17:49:42.769727 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 16/30] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:42 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1218 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:43.171758 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:43.172715 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:43.180182 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:43.181549 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:43.183826 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:43.184709 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:43.331283 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:43.343772 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:43.359699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:43.359699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7676d5b9-b428-41a7-9576-0ce624a7a622 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1286 microversion: 2.20 time: 0.191133 Jul 20 17:49:43.364579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 15/31] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:43 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:43.549067 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e5e99e96-3ed2-4d97-b00b-63e7c9eb30c3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:43.561612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e5e99e96-3ed2-4d97-b00b-63e7c9eb30c3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:43.641873 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e5e99e96-3ed2-4d97-b00b-63e7c9eb30c3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:43.650780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e5e99e96-3ed2-4d97-b00b-63e7c9eb30c3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1241 microversion: 2.1 time: 0.107406 Jul 20 17:49:43.661743 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 17/32] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:43 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:43.779699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0a807f96-42a2-4b2d-8457-d70cf5168ec4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:43.780474 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0a807f96-42a2-4b2d-8457-d70cf5168ec4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:43.789849 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a807f96-42a2-4b2d-8457-d70cf5168ec4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:43.790432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a807f96-42a2-4b2d-8457-d70cf5168ec4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:43.803245 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a807f96-42a2-4b2d-8457-d70cf5168ec4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:43.806176 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a807f96-42a2-4b2d-8457-d70cf5168ec4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:43.912932 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0a807f96-42a2-4b2d-8457-d70cf5168ec4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:43.918318 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0a807f96-42a2-4b2d-8457-d70cf5168ec4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1266 microversion: 2.1 time: 0.144878 Jul 20 17:49:43.918891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 16/33] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:43 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:44.376238 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:44.376975 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:44.397987 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:44.399688 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:44.404555 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:44.407983 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:44.533552 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:44.544352 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:44.546164 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:44.547646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f0dc82ae-b2c2-4e13-948c-7c69d09c1966 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1334 microversion: 2.20 time: 0.175298 Jul 20 17:49:44.548680 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 18/34] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:44 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1334 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:44.677740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-18742a44-7777-4817-b586-51d2a2d2e68b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:44.678402 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-18742a44-7777-4817-b586-51d2a2d2e68b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:44.690763 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-18742a44-7777-4817-b586-51d2a2d2e68b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:44.694196 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-18742a44-7777-4817-b586-51d2a2d2e68b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:44.695014 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-18742a44-7777-4817-b586-51d2a2d2e68b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:44.706882 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-18742a44-7777-4817-b586-51d2a2d2e68b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:44.936091 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2f6aecfa-9676-4208-ad11-39d0dba92e64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:44.938121 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2f6aecfa-9676-4208-ad11-39d0dba92e64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:44.945051 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f6aecfa-9676-4208-ad11-39d0dba92e64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:44.945746 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f6aecfa-9676-4208-ad11-39d0dba92e64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:44.946737 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f6aecfa-9676-4208-ad11-39d0dba92e64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:44.948199 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f6aecfa-9676-4208-ad11-39d0dba92e64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:45.024809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-18742a44-7777-4817-b586-51d2a2d2e68b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:45.032148 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-18742a44-7777-4817-b586-51d2a2d2e68b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1245 microversion: 2.1 time: 0.366615 Jul 20 17:49:45.035887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 17/35] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:44 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1245 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:45.091709 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2f6aecfa-9676-4208-ad11-39d0dba92e64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:45.110180 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2f6aecfa-9676-4208-ad11-39d0dba92e64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1272 microversion: 2.1 time: 0.178439 Jul 20 17:49:45.111429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 19/36] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:44 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:49:45.565784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:45.566623 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:45.572626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:45.573073 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:45.574119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:45.574707 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:45.651015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:45.659562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:45.661502 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:45.662883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-abeae0ab-29ca-4079-90aa-c809f729de49 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1342 microversion: 2.20 time: 0.101620 Jul 20 17:49:45.663444 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:45 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1342 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:46.049244 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d7182b85-8902-4c3e-815f-9d1ae230d637 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:46.049789 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d7182b85-8902-4c3e-815f-9d1ae230d637 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:46.055789 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d7182b85-8902-4c3e-815f-9d1ae230d637 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:46.056240 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d7182b85-8902-4c3e-815f-9d1ae230d637 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:46.057046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d7182b85-8902-4c3e-815f-9d1ae230d637 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:46.057743 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d7182b85-8902-4c3e-815f-9d1ae230d637 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:46.125646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d7182b85-8902-4c3e-815f-9d1ae230d637 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:46.127510 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cbc55e62-5365-4230-b99c-a750052de946 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:46.128656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cbc55e62-5365-4230-b99c-a750052de946 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:46.130722 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d7182b85-8902-4c3e-815f-9d1ae230d637 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1237 microversion: 2.1 time: 0.085409 Jul 20 17:49:46.131411 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 20/38] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:46 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:46.135391 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cbc55e62-5365-4230-b99c-a750052de946 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:46.136005 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cbc55e62-5365-4230-b99c-a750052de946 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:46.136944 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cbc55e62-5365-4230-b99c-a750052de946 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:46.137964 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cbc55e62-5365-4230-b99c-a750052de946 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:46.290047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cbc55e62-5365-4230-b99c-a750052de946 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:46.298057 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cbc55e62-5365-4230-b99c-a750052de946 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.174856 Jul 20 17:49:46.298673 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 19/39] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:46 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:49:46.683708 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:46.684313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:46.690291 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:46.690878 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:46.691628 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:46.692059 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:46.753153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:46.761335 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:46.762893 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:46.763984 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-965c18a4-d5bf-40de-8544-d7a0c7917da5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1342 microversion: 2.20 time: 0.084479 Jul 20 17:49:46.764558 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:46 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:47.148017 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-217df192-f5dc-4533-a64e-a315f41bfe67 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:47.148662 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-217df192-f5dc-4533-a64e-a315f41bfe67 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:47.154689 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-217df192-f5dc-4533-a64e-a315f41bfe67 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:47.155135 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-217df192-f5dc-4533-a64e-a315f41bfe67 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:47.155916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-217df192-f5dc-4533-a64e-a315f41bfe67 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:47.156351 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-217df192-f5dc-4533-a64e-a315f41bfe67 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:47.220939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-217df192-f5dc-4533-a64e-a315f41bfe67 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:47.228713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-217df192-f5dc-4533-a64e-a315f41bfe67 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1237 microversion: 2.1 time: 0.084369 Jul 20 17:49:47.229508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 20/41] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:47 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:47.316075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2e862068-c9c5-493e-99a6-b553e5bd5e50 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:47.316736 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2e862068-c9c5-493e-99a6-b553e5bd5e50 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:47.322609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e862068-c9c5-493e-99a6-b553e5bd5e50 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:47.323058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e862068-c9c5-493e-99a6-b553e5bd5e50 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:47.323816 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e862068-c9c5-493e-99a6-b553e5bd5e50 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:47.324255 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e862068-c9c5-493e-99a6-b553e5bd5e50 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:47.462512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2e862068-c9c5-493e-99a6-b553e5bd5e50 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:47.470428 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2e862068-c9c5-493e-99a6-b553e5bd5e50 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.158777 Jul 20 17:49:47.470991 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 22/42] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:47 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:47.785050 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:47.785665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:47.792641 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:47.793096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:47.793931 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:47.794375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:47.917296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:47.932695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:47.934256 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:47.935361 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e5b6db98-14cb-4d29-ab45-c3d8418be548 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1342 microversion: 2.20 time: 0.158060 Jul 20 17:49:47.936284 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 21/43] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:47 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:48.254320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-dff4c5ba-e5cc-43cc-b599-bc519c19c8fc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:48.258335 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-dff4c5ba-e5cc-43cc-b599-bc519c19c8fc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:48.279162 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dff4c5ba-e5cc-43cc-b599-bc519c19c8fc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:48.279162 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dff4c5ba-e5cc-43cc-b599-bc519c19c8fc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:48.283755 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dff4c5ba-e5cc-43cc-b599-bc519c19c8fc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:48.284503 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dff4c5ba-e5cc-43cc-b599-bc519c19c8fc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:48.451918 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-dff4c5ba-e5cc-43cc-b599-bc519c19c8fc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:48.464969 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-dff4c5ba-e5cc-43cc-b599-bc519c19c8fc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1293 microversion: 2.1 time: 0.222015 Jul 20 17:49:48.465642 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 23/44] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:48 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:48.489009 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-933392da-4186-4627-8fcb-90ee5d7482d3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:48.491420 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-933392da-4186-4627-8fcb-90ee5d7482d3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:48.506689 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-933392da-4186-4627-8fcb-90ee5d7482d3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:48.507545 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-933392da-4186-4627-8fcb-90ee5d7482d3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:48.508967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-933392da-4186-4627-8fcb-90ee5d7482d3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:48.509710 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-933392da-4186-4627-8fcb-90ee5d7482d3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:48.956693 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:48.958382 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:48.976497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:48.977679 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:48.978977 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:48.979860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:49.094421 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-933392da-4186-4627-8fcb-90ee5d7482d3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:49.104830 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-933392da-4186-4627-8fcb-90ee5d7482d3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.620229 Jul 20 17:49:49.117002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 22/45] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:48 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:49.138196 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7ef66031-8403-48be-ac6f-87c23ea6b7ec tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3dc189d0>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:49.158687 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:49.174627 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:49.179101 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:49.182053 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d4bf6aaf-11b2-4a70-8adf-723650d9ba27 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1340 microversion: 2.20 time: 0.230956 Jul 20 17:49:49.182905 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:48 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1340 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:49.269937 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7ef66031-8403-48be-ac6f-87c23ea6b7ec tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f3418531-be1b-4665-ba4d-5c97ed10e30a" status: 200 len: 350 microversion: 2.1 time: 0.136482 Jul 20 17:49:49.271126 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 23/47] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:49:49 2022] GET /compute/v2.1/os-volumes/f3418531-be1b-4665-ba4d-5c97ed10e30a => generated 350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:49:49.483137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cb243897-3ac2-4e36-8759-795f6aa340f7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:49.484263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cb243897-3ac2-4e36-8759-795f6aa340f7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:49.504813 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb243897-3ac2-4e36-8759-795f6aa340f7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:49.509770 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb243897-3ac2-4e36-8759-795f6aa340f7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:49.513710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb243897-3ac2-4e36-8759-795f6aa340f7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:49.519886 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb243897-3ac2-4e36-8759-795f6aa340f7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:49.894456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cb243897-3ac2-4e36-8759-795f6aa340f7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:49.906114 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cb243897-3ac2-4e36-8759-795f6aa340f7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1299 microversion: 2.1 time: 0.427119 Jul 20 17:49:49.911081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:49 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1299 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:50.123108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7c8e51ec-491b-40bd-8b25-30515dfa9eec tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:50.125359 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7c8e51ec-491b-40bd-8b25-30515dfa9eec tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:50.133169 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7c8e51ec-491b-40bd-8b25-30515dfa9eec tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:50.133951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7c8e51ec-491b-40bd-8b25-30515dfa9eec tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:50.135036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7c8e51ec-491b-40bd-8b25-30515dfa9eec tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:50.135681 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7c8e51ec-491b-40bd-8b25-30515dfa9eec tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:50.205780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:50.206491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:50.214325 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:50.218134 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:50.218134 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:50.218134 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:50.285817 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=4 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:50.348851 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:50.357846 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:50.359801 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:50.361108 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-836b5b2a-47a1-4e68-9ab4-860b910455bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1340 microversion: 2.20 time: 0.163167 Jul 20 17:49:50.361920 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 26/49] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:50 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1340 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:49:50.371786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7c8e51ec-491b-40bd-8b25-30515dfa9eec tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:50.381309 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7c8e51ec-491b-40bd-8b25-30515dfa9eec tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.262697 Jul 20 17:49:50.389056 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 24/50] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:50 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:50.930473 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-da698ee0-77b8-4aec-80e9-46c7b59e162d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:50.931175 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-da698ee0-77b8-4aec-80e9-46c7b59e162d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:50.956314 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da698ee0-77b8-4aec-80e9-46c7b59e162d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:50.958916 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da698ee0-77b8-4aec-80e9-46c7b59e162d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:50.960382 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da698ee0-77b8-4aec-80e9-46c7b59e162d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:50.963499 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da698ee0-77b8-4aec-80e9-46c7b59e162d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:51.387839 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:51.391530 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:51.415698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:51.416201 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:51.425406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:51.425877 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:51.892534 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-da698ee0-77b8-4aec-80e9-46c7b59e162d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:51.904211 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-da698ee0-77b8-4aec-80e9-46c7b59e162d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.977349 Jul 20 17:49:51.926896 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 27/51] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:50 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:51.926896 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2a4eba0c-444b-49a8-aebf-20069c041b2d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:51.926896 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2a4eba0c-444b-49a8-aebf-20069c041b2d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:51.930891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2a4eba0c-444b-49a8-aebf-20069c041b2d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:51.931489 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2a4eba0c-444b-49a8-aebf-20069c041b2d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:51.932133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2a4eba0c-444b-49a8-aebf-20069c041b2d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:51.932876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2a4eba0c-444b-49a8-aebf-20069c041b2d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:52.154548 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:52.467992 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:52.519487 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:52.523723 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:52.525470 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b48ee314-c70d-4ce8-8c6c-434d907f7d97 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 1.141911 Jul 20 17:49:52.529264 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 25/52] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:51 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:49:52.543616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=28 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:52.631465 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2a4eba0c-444b-49a8-aebf-20069c041b2d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:52.667708 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2a4eba0c-444b-49a8-aebf-20069c041b2d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.742746 Jul 20 17:49:52.668385 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 28/53] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:51 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:52.701514 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-58c09e48-8832-466f-8b8d-94c148f3117d tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3e3e8f70>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:52.888985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-58c09e48-8832-466f-8b8d-94c148f3117d tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b152999-0925-4d43-8fd5-23ad593b363a" status: 200 len: 351 microversion: 2.1 time: 0.212102 Jul 20 17:49:52.888985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 29/54] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:49:52 2022] GET /compute/v2.1/os-volumes/4b152999-0925-4d43-8fd5-23ad593b363a => generated 351 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:52.938928 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-579cae54-66c8-4e23-9103-6fa8a43848f3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:52.940276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-579cae54-66c8-4e23-9103-6fa8a43848f3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:52.958163 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-579cae54-66c8-4e23-9103-6fa8a43848f3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:52.959921 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-579cae54-66c8-4e23-9103-6fa8a43848f3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:52.965615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-579cae54-66c8-4e23-9103-6fa8a43848f3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:52.967416 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-579cae54-66c8-4e23-9103-6fa8a43848f3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:53.187171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-1b07da55-d37a-482f-b339-de917697870a req-7d24c149-5a56-4eba-a31e-943056bd6d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7911d50-9baa-455c-8821-9167e6f35b4d", "tag": "64ac2385-a271-4bc9-98e9-b7149eb12088"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:53.192912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:53.204464 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-1b07da55-d37a-482f-b339-de917697870a req-7d24c149-5a56-4eba-a31e-943056bd6d5f service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:53.205102 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-1b07da55-d37a-482f-b339-de917697870a req-7d24c149-5a56-4eba-a31e-943056bd6d5f service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:53.248937 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-1b07da55-d37a-482f-b339-de917697870a req-7d24c149-5a56-4eba-a31e-943056bd6d5f service nova] Creating event network-changed:64ac2385-a271-4bc9-98e9-b7149eb12088 for instance f7911d50-9baa-455c-8821-9167e6f35b4d on hv-cinder-84984 Jul 20 17:49:53.249916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-1b07da55-d37a-482f-b339-de917697870a req-7d24c149-5a56-4eba-a31e-943056bd6d5f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124846) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 17:49:53.252736 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-836ef248-a5b4-4b59-ad5b-2affa8c43ae5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:53.253807 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-836ef248-a5b4-4b59-ad5b-2affa8c43ae5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:53.255543 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-836ef248-a5b4-4b59-ad5b-2affa8c43ae5 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:53.256612 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-836ef248-a5b4-4b59-ad5b-2affa8c43ae5 None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:53.274203 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.compute.rpcapi [None req-836ef248-a5b4-4b59-ad5b-2affa8c43ae5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 17:49:53.275798 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-836ef248-a5b4-4b59-ad5b-2affa8c43ae5 None None] Releasing lock "compute-rpcapi-router" {{(pid=124846) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 17:49:53.294951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-836ef248-a5b4-4b59-ad5b-2affa8c43ae5 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.767141 Jul 20 17:49:53.296619 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 26/55] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:53.527997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-579cae54-66c8-4e23-9103-6fa8a43848f3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:53.547346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:53.553131 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:53.571436 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:53.571566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-579cae54-66c8-4e23-9103-6fa8a43848f3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.630428 Jul 20 17:49:53.571901 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:53.572577 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 30/56] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:52 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:53.583190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:53.583742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:53.690064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a79c1a24-3175-4fb4-9f7d-8a848064f3cf tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:53.691019 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a79c1a24-3175-4fb4-9f7d-8a848064f3cf tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:53.705145 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=12 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:53.713439 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a79c1a24-3175-4fb4-9f7d-8a848064f3cf tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:53.720075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a79c1a24-3175-4fb4-9f7d-8a848064f3cf tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:53.725417 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a79c1a24-3175-4fb4-9f7d-8a848064f3cf tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:53.726349 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a79c1a24-3175-4fb4-9f7d-8a848064f3cf tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:54.233101 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a79c1a24-3175-4fb4-9f7d-8a848064f3cf tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:54.246720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a79c1a24-3175-4fb4-9f7d-8a848064f3cf tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.561331 Jul 20 17:49:54.247749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 31/57] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:53 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:54.289428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:54.298768 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:54.300764 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:54.302442 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-095bd48c-c673-4339-a9a7-054d7ca791a2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.759480 Jul 20 17:49:54.303325 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 27/58] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:53 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:54.425575 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-e7e6ac8d-5917-416a-b77a-8c6512edf89e req-9365943f-b9db-4093-bbe6-f8fac56b437d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a9d731-6fac-4e62-a247-194eb02970a2", "tag": "b4d1a842-ac4e-4cea-b6c2-edcf4932e3d1"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:54.440083 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e7e6ac8d-5917-416a-b77a-8c6512edf89e req-9365943f-b9db-4093-bbe6-f8fac56b437d service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:54.440559 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e7e6ac8d-5917-416a-b77a-8c6512edf89e req-9365943f-b9db-4093-bbe6-f8fac56b437d service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:54.460234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-e7e6ac8d-5917-416a-b77a-8c6512edf89e req-9365943f-b9db-4093-bbe6-f8fac56b437d service nova] Creating event network-changed:b4d1a842-ac4e-4cea-b6c2-edcf4932e3d1 for instance b8a9d731-6fac-4e62-a247-194eb02970a2 on hv-cinder-84984 Jul 20 17:49:54.461172 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e7e6ac8d-5917-416a-b77a-8c6512edf89e req-9365943f-b9db-4093-bbe6-f8fac56b437d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124845) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 17:49:54.462299 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c95f47d2-7956-4242-bc56-044d74a21dce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:54.462877 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c95f47d2-7956-4242-bc56-044d74a21dce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:54.463672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c95f47d2-7956-4242-bc56-044d74a21dce None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:54.464106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c95f47d2-7956-4242-bc56-044d74a21dce None None] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:54.474301 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.compute.rpcapi [None req-c95f47d2-7956-4242-bc56-044d74a21dce None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 17:49:54.475239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c95f47d2-7956-4242-bc56-044d74a21dce None None] Releasing lock "compute-rpcapi-router" {{(pid=124845) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 17:49:54.499119 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c95f47d2-7956-4242-bc56-044d74a21dce None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250002 Jul 20 17:49:54.499755 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 32/59] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:54.591292 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c71438c9-5e68-4bc0-ac98-3d83e3cbab60 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:54.592033 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c71438c9-5e68-4bc0-ac98-3d83e3cbab60 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:54.599260 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c71438c9-5e68-4bc0-ac98-3d83e3cbab60 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:54.599966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c71438c9-5e68-4bc0-ac98-3d83e3cbab60 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:54.600967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c71438c9-5e68-4bc0-ac98-3d83e3cbab60 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:54.601584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c71438c9-5e68-4bc0-ac98-3d83e3cbab60 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:54.743123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c71438c9-5e68-4bc0-ac98-3d83e3cbab60 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:54.750801 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c71438c9-5e68-4bc0-ac98-3d83e3cbab60 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.163474 Jul 20 17:49:54.751460 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 28/60] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:54 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:55.264227 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0fe12acd-df28-4be5-a089-104efbb35f34 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:55.264984 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0fe12acd-df28-4be5-a089-104efbb35f34 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:55.272804 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fe12acd-df28-4be5-a089-104efbb35f34 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:55.273263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fe12acd-df28-4be5-a089-104efbb35f34 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:55.282394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fe12acd-df28-4be5-a089-104efbb35f34 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:55.283759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fe12acd-df28-4be5-a089-104efbb35f34 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:55.325083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:55.327197 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:55.338674 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:55.339719 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:55.340888 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:55.342125 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:55.733730 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0fe12acd-df28-4be5-a089-104efbb35f34 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:55.742507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:55.751130 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0fe12acd-df28-4be5-a089-104efbb35f34 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.491544 Jul 20 17:49:55.754168 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:55.756050 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:55.757351 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-65e9f799-8bb9-4cee-a0d4-c9d17377a6a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.440587 Jul 20 17:49:55.761806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 33/61] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:55 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:55.767747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-0b3061fe-34bf-4fbc-9d6a-7af6b4e358d1 req-06475e97-af90-423c-a5dd-cd091c0f8cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b246c9-d9df-4348-9d5a-61c1170b1951", "tag": "c0861927-5eef-4dee-a02c-a3bed737a580"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:49:55.768788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 29/62] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:55 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:55.773778 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-dea699fe-e109-4dec-9c9d-9942ad51c44a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:55.774654 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-dea699fe-e109-4dec-9c9d-9942ad51c44a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:55.776478 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0b3061fe-34bf-4fbc-9d6a-7af6b4e358d1 req-06475e97-af90-423c-a5dd-cd091c0f8cc8 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:55.777095 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0b3061fe-34bf-4fbc-9d6a-7af6b4e358d1 req-06475e97-af90-423c-a5dd-cd091c0f8cc8 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:55.782140 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dea699fe-e109-4dec-9c9d-9942ad51c44a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:55.782672 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dea699fe-e109-4dec-9c9d-9942ad51c44a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:55.783563 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dea699fe-e109-4dec-9c9d-9942ad51c44a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:55.784083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dea699fe-e109-4dec-9c9d-9942ad51c44a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:55.790516 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-0b3061fe-34bf-4fbc-9d6a-7af6b4e358d1 req-06475e97-af90-423c-a5dd-cd091c0f8cc8 service nova] Creating event network-changed:c0861927-5eef-4dee-a02c-a3bed737a580 for instance 45b246c9-d9df-4348-9d5a-61c1170b1951 on hv-cinder-84984 Jul 20 17:49:55.800152 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-0b3061fe-34bf-4fbc-9d6a-7af6b4e358d1 req-06475e97-af90-423c-a5dd-cd091c0f8cc8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032485 Jul 20 17:49:55.800152 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 34/63] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:55.939032 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-dea699fe-e109-4dec-9c9d-9942ad51c44a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:55.946897 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-dea699fe-e109-4dec-9c9d-9942ad51c44a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.176867 Jul 20 17:49:55.947745 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 30/64] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:55 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:56.511746 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b0290810-94e1-4db0-a6e3-d37fee92cbee tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3e3fe1f0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:56.567545 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b0290810-94e1-4db0-a6e3-d37fee92cbee tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/8ddba740-4c9d-4e12-80f4-cb926e891406" status: 200 len: 350 microversion: 2.1 time: 0.061193 Jul 20 17:49:56.568363 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 35/65] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:49:56 2022] GET /compute/v2.1/os-volumes/8ddba740-4c9d-4e12-80f4-cb926e891406 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:56.579865 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-69e7d435-98db-405c-99b7-eed169538182 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3dc31e50>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:56.770848 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9514931f-8014-44cb-9470-8bff7763243a tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:56.772416 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9514931f-8014-44cb-9470-8bff7763243a tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:56.784891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9514931f-8014-44cb-9470-8bff7763243a tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:56.785409 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9514931f-8014-44cb-9470-8bff7763243a tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:56.787815 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9514931f-8014-44cb-9470-8bff7763243a tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:56.789509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9514931f-8014-44cb-9470-8bff7763243a tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:56.804153 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-69e7d435-98db-405c-99b7-eed169538182 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.228082 Jul 20 17:49:56.805032 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 31/66] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Jul 20 17:49:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:49:56.817203 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:56.817815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:56.829885 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:56.831365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:56.836031 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:56.836031 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:56.836031 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:57.072512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9514931f-8014-44cb-9470-8bff7763243a tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:57.074383 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:57.084333 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:57.085900 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:57.087013 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-de4e242b-2f35-424d-9fd4-6892941b5125 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.280687 Jul 20 17:49:57.087203 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9514931f-8014-44cb-9470-8bff7763243a tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.321801 Jul 20 17:49:57.087593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 32/67] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:56 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:57.106376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f2cd2e19-eefe-4333-908a-e9b7f5a02ce5 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3dc8b9d0>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:57.112088 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 36/68] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:56 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:57.126307 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7814b8e4-131e-40ae-8812-e04c86a69483 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:57.126307 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7814b8e4-131e-40ae-8812-e04c86a69483 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:57.126307 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7814b8e4-131e-40ae-8812-e04c86a69483 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:57.126644 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7814b8e4-131e-40ae-8812-e04c86a69483 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:57.127297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7814b8e4-131e-40ae-8812-e04c86a69483 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:57.127723 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7814b8e4-131e-40ae-8812-e04c86a69483 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:57.312694 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f2cd2e19-eefe-4333-908a-e9b7f5a02ce5 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.222866 Jul 20 17:49:57.313967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 33/69] 10.222.0.42 () {58 vars in 1148 bytes} [Wed Jul 20 17:49:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:57.328992 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a8de0cfe-1ac2-4eb2-83c1-76f24b456084 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3dc5ce50>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:57.387462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7814b8e4-131e-40ae-8812-e04c86a69483 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:57.396508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7814b8e4-131e-40ae-8812-e04c86a69483 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.283472 Jul 20 17:49:57.407354 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 37/70] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:57 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:57.486146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a8de0cfe-1ac2-4eb2-83c1-76f24b456084 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.164116 Jul 20 17:49:57.486986 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 34/71] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Jul 20 17:49:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:49:57.500128 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-85d27255-fd23-41fe-879b-010da16ceedc tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3e3e8ca0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:57.594184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-85d27255-fd23-41fe-879b-010da16ceedc tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098595 Jul 20 17:49:57.595138 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 38/72] 10.222.0.42 () {58 vars in 1166 bytes} [Wed Jul 20 17:49:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:49:57.609425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3295c152-4aeb-4f64-b3b9-c9098d71d434 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3dbdeb80>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:57.742950 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3295c152-4aeb-4f64-b3b9-c9098d71d434 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.138631 Jul 20 17:49:57.743585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 35/73] 10.222.0.42 () {58 vars in 1169 bytes} [Wed Jul 20 17:49:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:57.763448 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2bd06a69-a813-4132-b286-e9830f024c19 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3e3feca0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:57.891577 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2bd06a69-a813-4132-b286-e9830f024c19 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.135490 Jul 20 17:49:57.892236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 39/74] 10.222.0.42 () {58 vars in 1154 bytes} [Wed Jul 20 17:49:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:57.907897 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-04fd05b6-7438-4dae-8c6e-d0528e2f9f97 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3dc433a0>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:58.003296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-04fd05b6-7438-4dae-8c6e-d0528e2f9f97 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101192 Jul 20 17:49:58.004155 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 36/75] 10.222.0.42 () {58 vars in 1187 bytes} [Wed Jul 20 17:49:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:49:58.018588 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a98fb3b1-80ed-4432-91cc-62580d6da609 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] Calling method '.version_select at 0x7f7d3e487e50>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:58.111279 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:58.111884 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:58.120858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:58.121581 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:58.122524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:58.123100 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:58.132555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=100 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:58.137068 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a98fb3b1-80ed-4432-91cc-62580d6da609 tempest-VolumesTestJSON-363339394 tempest-VolumesTestJSON-363339394-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.124245 Jul 20 17:49:58.137644 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 40/76] 10.222.0.42 () {58 vars in 1154 bytes} [Wed Jul 20 17:49:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:58.159199 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e33af550-caa2-4cf0-9e0a-984b0182f3b9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:58.160032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e33af550-caa2-4cf0-9e0a-984b0182f3b9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:58.166494 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e33af550-caa2-4cf0-9e0a-984b0182f3b9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:58.167367 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e33af550-caa2-4cf0-9e0a-984b0182f3b9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:58.169802 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e33af550-caa2-4cf0-9e0a-984b0182f3b9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:58.170611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e33af550-caa2-4cf0-9e0a-984b0182f3b9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:58.414769 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:58.420605 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e33af550-caa2-4cf0-9e0a-984b0182f3b9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:58.431417 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e33af550-caa2-4cf0-9e0a-984b0182f3b9 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.281612 Jul 20 17:49:58.433086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 41/77] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:58 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:58.439367 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a493335b-dd9f-4584-b211-2545f00bb9d7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:58.440230 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a493335b-dd9f-4584-b211-2545f00bb9d7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:58.447076 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a493335b-dd9f-4584-b211-2545f00bb9d7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:58.447875 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a493335b-dd9f-4584-b211-2545f00bb9d7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:58.447997 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:58.449154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a493335b-dd9f-4584-b211-2545f00bb9d7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:58.449864 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a493335b-dd9f-4584-b211-2545f00bb9d7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:58.451023 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:58.463096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-da10ce61-e094-4f55-846e-f7c2d175e2ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.355233 Jul 20 17:49:58.472463 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 37/78] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:58 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:49:58.688140 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a493335b-dd9f-4584-b211-2545f00bb9d7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:58.696315 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a493335b-dd9f-4584-b211-2545f00bb9d7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.261891 Jul 20 17:49:58.696936 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 42/79] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:58 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:59.461385 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d49b87ca-dbf6-42a6-8198-211068667b7c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:59.462512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d49b87ca-dbf6-42a6-8198-211068667b7c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:59.474804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d49b87ca-dbf6-42a6-8198-211068667b7c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:59.475281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d49b87ca-dbf6-42a6-8198-211068667b7c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:59.476091 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d49b87ca-dbf6-42a6-8198-211068667b7c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:59.477571 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d49b87ca-dbf6-42a6-8198-211068667b7c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:59.490747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:59.491710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:59.501002 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:59.501674 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:59.502515 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:59.503737 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:59.836092 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d49b87ca-dbf6-42a6-8198-211068667b7c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:59.839749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:59.846842 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d49b87ca-dbf6-42a6-8198-211068667b7c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.399024 Jul 20 17:49:59.847433 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 38/80] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:59 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:49:59.854307 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0e205ce3-1edb-427b-be5f-8b60b88c165d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:49:59.855440 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:59.857134 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0e205ce3-1edb-427b-be5f-8b60b88c165d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:49:59.862422 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:49:59.862422 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9b9db0c3-d12f-4a27-97b1-8ace671184bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.372353 Jul 20 17:49:59.862422 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 43/81] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:49:59 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:49:59.866285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e205ce3-1edb-427b-be5f-8b60b88c165d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:59.866979 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e205ce3-1edb-427b-be5f-8b60b88c165d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:49:59.868576 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e205ce3-1edb-427b-be5f-8b60b88c165d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:49:59.869331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e205ce3-1edb-427b-be5f-8b60b88c165d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:00.025840 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0e205ce3-1edb-427b-be5f-8b60b88c165d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:00.034422 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0e205ce3-1edb-427b-be5f-8b60b88c165d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.183670 Jul 20 17:50:00.034996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 39/82] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:49:59 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:00.864281 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4f5d3731-8090-4ea3-af21-79f471f4b88e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:00.865491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4f5d3731-8090-4ea3-af21-79f471f4b88e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:00.878900 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:00.879562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:00.882931 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f5d3731-8090-4ea3-af21-79f471f4b88e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:00.885265 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f5d3731-8090-4ea3-af21-79f471f4b88e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:00.886370 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f5d3731-8090-4ea3-af21-79f471f4b88e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:00.887398 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:00.888200 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:00.888830 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f5d3731-8090-4ea3-af21-79f471f4b88e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:00.889432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:00.890598 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:01.098742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:01.108008 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:01.110638 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4f5d3731-8090-4ea3-af21-79f471f4b88e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:01.110791 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:01.110791 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c4d54f60-562b-42e0-9a18-99e696ca2770 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.235675 Jul 20 17:50:01.111289 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 40/83] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:00 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:01.115796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-17938c84-f09f-4d8b-9950-cc22111198bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:01.116401 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-17938c84-f09f-4d8b-9950-cc22111198bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:01.116577 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4f5d3731-8090-4ea3-af21-79f471f4b88e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.256537 Jul 20 17:50:01.117297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 44/84] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:00 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:01.123274 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-17938c84-f09f-4d8b-9950-cc22111198bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:01.123794 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-17938c84-f09f-4d8b-9950-cc22111198bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:01.125196 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-17938c84-f09f-4d8b-9950-cc22111198bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:01.125717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-17938c84-f09f-4d8b-9950-cc22111198bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:01.256835 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-17938c84-f09f-4d8b-9950-cc22111198bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:01.265783 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-17938c84-f09f-4d8b-9950-cc22111198bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.152794 Jul 20 17:50:01.266726 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 41/85] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:01 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:02.130305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:02.131653 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:02.136123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-afc0fc85-671c-47de-bb9c-adeaf8c05007 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:02.137535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-afc0fc85-671c-47de-bb9c-adeaf8c05007 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:02.146509 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-afc0fc85-671c-47de-bb9c-adeaf8c05007 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:02.147255 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-afc0fc85-671c-47de-bb9c-adeaf8c05007 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:02.148026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-afc0fc85-671c-47de-bb9c-adeaf8c05007 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:02.148690 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-afc0fc85-671c-47de-bb9c-adeaf8c05007 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:02.158074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:02.158074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:02.158074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:02.158074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:02.354874 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-afc0fc85-671c-47de-bb9c-adeaf8c05007 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:02.358978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:02.362503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-afc0fc85-671c-47de-bb9c-adeaf8c05007 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.231984 Jul 20 17:50:02.363075 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 42/86] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:02 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:02.367363 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:02.372347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-08ea988c-93be-4845-ab71-aa4dae34d189 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:02.372347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-08ea988c-93be-4845-ab71-aa4dae34d189 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:02.372581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:02.372581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5f9bcd31-e10e-4c6f-833a-a1e9f7a6b79f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.245868 Jul 20 17:50:02.372581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 45/87] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:02 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:02.374108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08ea988c-93be-4845-ab71-aa4dae34d189 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:02.374558 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08ea988c-93be-4845-ab71-aa4dae34d189 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:02.375323 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08ea988c-93be-4845-ab71-aa4dae34d189 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:02.375757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08ea988c-93be-4845-ab71-aa4dae34d189 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:02.509253 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-08ea988c-93be-4845-ab71-aa4dae34d189 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:02.517498 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-08ea988c-93be-4845-ab71-aa4dae34d189 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.153453 Jul 20 17:50:02.518240 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 43/88] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:02 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:03.395863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cdc1ae09-2967-4a56-b60e-1bca50a8b1a3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:03.396740 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cdc1ae09-2967-4a56-b60e-1bca50a8b1a3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:03.397075 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:03.397859 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:03.403296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:03.404912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:03.405173 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cdc1ae09-2967-4a56-b60e-1bca50a8b1a3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:03.405327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:03.405626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cdc1ae09-2967-4a56-b60e-1bca50a8b1a3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:03.406195 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:03.406648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:03.407544 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cdc1ae09-2967-4a56-b60e-1bca50a8b1a3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:03.407996 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cdc1ae09-2967-4a56-b60e-1bca50a8b1a3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:03.782686 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:03.790033 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cdc1ae09-2967-4a56-b60e-1bca50a8b1a3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:03.791636 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:03.793317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:03.794603 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4c9b093f-3aa5-4cb4-9414-eeed03d6c11c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.401649 Jul 20 17:50:03.797938 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cdc1ae09-2967-4a56-b60e-1bca50a8b1a3 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.406220 Jul 20 17:50:03.798581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 46/89] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:03 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:50:03.806079 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 44/90] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:03 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:50:03.809727 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3128f00f-0c93-4eaa-b330-ac174eca8dc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:03.810675 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3128f00f-0c93-4eaa-b330-ac174eca8dc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:03.824273 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3128f00f-0c93-4eaa-b330-ac174eca8dc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:03.824790 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3128f00f-0c93-4eaa-b330-ac174eca8dc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:03.825624 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3128f00f-0c93-4eaa-b330-ac174eca8dc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:03.826055 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3128f00f-0c93-4eaa-b330-ac174eca8dc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:03.968740 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3128f00f-0c93-4eaa-b330-ac174eca8dc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:03.976314 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3128f00f-0c93-4eaa-b330-ac174eca8dc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.176636 Jul 20 17:50:03.976949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 47/91] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:03 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:04.814664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2679dea3-9d1e-4135-821c-31b336e6f619 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:04.815606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:04.816000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2679dea3-9d1e-4135-821c-31b336e6f619 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:04.816769 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:04.817905 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:04.830835 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:04.832001 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:04.833143 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2679dea3-9d1e-4135-821c-31b336e6f619 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:04.833626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2679dea3-9d1e-4135-821c-31b336e6f619 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:04.835309 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:04.836305 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:04.836968 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2679dea3-9d1e-4135-821c-31b336e6f619 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:04.839058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2679dea3-9d1e-4135-821c-31b336e6f619 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:05.116304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:05.122808 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2679dea3-9d1e-4135-821c-31b336e6f619 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:05.123168 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:05.125361 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:05.126414 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0b50acda-c729-4224-a8e1-484aa7a429ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.315768 Jul 20 17:50:05.127107 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 45/92] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:04 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:05.135865 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2679dea3-9d1e-4135-821c-31b336e6f619 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.324869 Jul 20 17:50:05.136100 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9f98ddcb-970e-4cf8-bde5-f71a927ae146 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:05.136839 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 48/93] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:04 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:05.137065 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9f98ddcb-970e-4cf8-bde5-f71a927ae146 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:05.148857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9f98ddcb-970e-4cf8-bde5-f71a927ae146 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:05.149461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9f98ddcb-970e-4cf8-bde5-f71a927ae146 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:05.156038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9f98ddcb-970e-4cf8-bde5-f71a927ae146 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:05.156038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9f98ddcb-970e-4cf8-bde5-f71a927ae146 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:05.306590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9f98ddcb-970e-4cf8-bde5-f71a927ae146 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:05.316678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9f98ddcb-970e-4cf8-bde5-f71a927ae146 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.186980 Jul 20 17:50:05.316678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 46/94] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:05 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:06.149738 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:06.150231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:06.157102 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:06.157546 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:06.158303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:06.158477 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c2500dcc-5abd-4ec0-bcc8-d5a4d454170f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:06.158852 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:06.159092 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c2500dcc-5abd-4ec0-bcc8-d5a4d454170f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:06.165210 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2500dcc-5abd-4ec0-bcc8-d5a4d454170f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:06.165663 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2500dcc-5abd-4ec0-bcc8-d5a4d454170f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:06.166428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2500dcc-5abd-4ec0-bcc8-d5a4d454170f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:06.166893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2500dcc-5abd-4ec0-bcc8-d5a4d454170f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:06.382398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:06.382398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:06.382607 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:06.382607 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-34b5bb4b-4dab-4de3-9481-5ee662094c8f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.212550 Jul 20 17:50:06.382767 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c2500dcc-5abd-4ec0-bcc8-d5a4d454170f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:06.382870 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 49/95] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:06 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:06.382870 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ca72503a-576f-485f-941e-403823c09cdf tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:06.382870 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ca72503a-576f-485f-941e-403823c09cdf tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:06.383084 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c2500dcc-5abd-4ec0-bcc8-d5a4d454170f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.212342 Jul 20 17:50:06.383084 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 47/96] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:06 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:06.383239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca72503a-576f-485f-941e-403823c09cdf tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:06.383239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca72503a-576f-485f-941e-403823c09cdf tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:06.383239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca72503a-576f-485f-941e-403823c09cdf tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:06.383239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca72503a-576f-485f-941e-403823c09cdf tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:06.670623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ca72503a-576f-485f-941e-403823c09cdf tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:06.671832 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ca72503a-576f-485f-941e-403823c09cdf tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.312312 Jul 20 17:50:06.672611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 50/97] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:06 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:07.413076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:07.416021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:07.416115 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8120e9a8-1873-4b03-978e-0ed25e95efc5 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:07.416115 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8120e9a8-1873-4b03-978e-0ed25e95efc5 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:07.420984 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:07.421524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:07.421628 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8120e9a8-1873-4b03-978e-0ed25e95efc5 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:07.422005 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8120e9a8-1873-4b03-978e-0ed25e95efc5 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:07.422287 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:07.422727 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:07.422833 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8120e9a8-1873-4b03-978e-0ed25e95efc5 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:07.423178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8120e9a8-1873-4b03-978e-0ed25e95efc5 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:07.614604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:07.618679 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8120e9a8-1873-4b03-978e-0ed25e95efc5 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:07.622813 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:07.624323 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:07.625534 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4bcfb434-c4fc-4655-a260-469395a1f13a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.216855 Jul 20 17:50:07.630314 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 48/98] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:07 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:07.630861 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8120e9a8-1873-4b03-978e-0ed25e95efc5 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.215325 Jul 20 17:50:07.630861 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 51/99] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:07 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:50:07.688898 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-78f57c4e-e354-48cf-ae79-d34fa919cdb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:07.689430 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-78f57c4e-e354-48cf-ae79-d34fa919cdb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:07.695511 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-78f57c4e-e354-48cf-ae79-d34fa919cdb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:07.695960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-78f57c4e-e354-48cf-ae79-d34fa919cdb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:07.696751 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-78f57c4e-e354-48cf-ae79-d34fa919cdb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:07.697179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-78f57c4e-e354-48cf-ae79-d34fa919cdb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:07.824510 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-78f57c4e-e354-48cf-ae79-d34fa919cdb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:07.832662 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-78f57c4e-e354-48cf-ae79-d34fa919cdb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.148158 Jul 20 17:50:07.837207 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 49/100] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:07 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:08.646985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:08.646985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:08.647526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-581a3b71-feba-460e-9dec-332f4a4a707c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:08.647526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-581a3b71-feba-460e-9dec-332f4a4a707c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:08.651394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:08.655698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-581a3b71-feba-460e-9dec-332f4a4a707c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:08.656566 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-581a3b71-feba-460e-9dec-332f4a4a707c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:08.657721 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-581a3b71-feba-460e-9dec-332f4a4a707c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:08.658006 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:08.658568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-581a3b71-feba-460e-9dec-332f4a4a707c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:08.658833 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:08.659844 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:08.871222 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:08.881280 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:08.887953 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-581a3b71-feba-460e-9dec-332f4a4a707c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:08.889710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:08.894232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-59715d28-6e2e-4667-a797-d97bfaeb974d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.254885 Jul 20 17:50:08.894830 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 52/101] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:08 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:08.902303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f1a3287d-1429-436b-b42d-41608952d05f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:08.903001 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f1a3287d-1429-436b-b42d-41608952d05f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:08.908692 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:08.910701 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f1a3287d-1429-436b-b42d-41608952d05f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:08.911300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f1a3287d-1429-436b-b42d-41608952d05f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:08.912341 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f1a3287d-1429-436b-b42d-41608952d05f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:08.912800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f1a3287d-1429-436b-b42d-41608952d05f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:08.912974 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-581a3b71-feba-460e-9dec-332f4a4a707c tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.270525 Jul 20 17:50:08.913678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 50/102] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:08 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:09.076247 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f1a3287d-1429-436b-b42d-41608952d05f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:09.084938 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f1a3287d-1429-436b-b42d-41608952d05f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.188949 Jul 20 17:50:09.085701 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 53/103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:08 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:09.914154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:09.928077 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:09.928077 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:09.928077 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:09.928077 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:09.928702 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:09.931876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-75f039c8-4927-4800-a2b3-ea931a2872bc tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:09.933310 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-75f039c8-4927-4800-a2b3-ea931a2872bc tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:09.945278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-75f039c8-4927-4800-a2b3-ea931a2872bc tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:09.946630 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-75f039c8-4927-4800-a2b3-ea931a2872bc tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:09.950990 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-75f039c8-4927-4800-a2b3-ea931a2872bc tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:09.951540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-75f039c8-4927-4800-a2b3-ea931a2872bc tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:10.214741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:10.241724 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:10.247898 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:10.250412 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9783cfa8-1ecb-4ed1-8dee-5d8ada6cb679 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.341232 Jul 20 17:50:10.250999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 51/104] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:09 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:10.256693 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-75f039c8-4927-4800-a2b3-ea931a2872bc tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:10.267188 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-75f039c8-4927-4800-a2b3-ea931a2872bc tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.339769 Jul 20 17:50:10.270718 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 54/105] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:09 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:10.278399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f30004b4-a3b5-48e6-8a07-31bb1632a72b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:10.279412 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f30004b4-a3b5-48e6-8a07-31bb1632a72b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:10.294620 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f30004b4-a3b5-48e6-8a07-31bb1632a72b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:10.300077 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f30004b4-a3b5-48e6-8a07-31bb1632a72b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:10.301014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f30004b4-a3b5-48e6-8a07-31bb1632a72b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:10.301602 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f30004b4-a3b5-48e6-8a07-31bb1632a72b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:10.435808 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e4914cd3-c54b-4bfa-8ea7-decc934c1089 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Action: 'create', calling method: .version_select at 0x7f7d3dcf4160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2074896465", "metadata": {"Type": "work"}}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e4914cd3-c54b-4bfa-8ea7-decc934c1089 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Request method failure captured: Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 122 Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EBR_z5FophUba4E347xOmWUCr4V_y1poRkGmg3_sj8Ro6RWlb9OCgaGwvmLsqu3clD53LhMooGOQ8OdYyFFQSF4G1R-gD7rAGut8D6LelORtFOEkN9e0yf0wZbSX-EAGijpUPdo9cIwmbiaLg84-Z883EVxmqIKQ-30zb_hfceqdf0 Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:50:10.470796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e481023311984f5cb3388d7354d47fb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e481023311984f5cb3388d7354d47fb6"}]}] Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3deceff47f984622bce32990d5d5e599 Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2074896465", "metadata": {"Type": "work"}}} Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: Jul 20 17:50:10.472046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2074896465', 'metadata': {'Type': 'work'}}}} Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise error Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:10.472873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 17:50:10.474220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 17:50:10.475224 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 17:50:10.475224 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.475224 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e4914cd3-c54b-4bfa-8ea7-decc934c1089 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:10.475224 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e4914cd3-c54b-4bfa-8ea7-decc934c1089 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.219885 Jul 20 17:50:10.484842 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 52/106] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jul 20 17:50:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:50:10.490890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-76ee486f-1022-4779-ab10-a712369db417 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Action: 'create', calling method: .version_select at 0x7f7d3dbde4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-854773413", "metadata": {"Type": "work"}}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-76ee486f-1022-4779-ab10-a712369db417 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Request method failure captured: Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 119 Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EBR_z5FophUba4E347xOmWUCr4V_y1poRkGmg3_sj8Ro6RWlb9OCgaGwvmLsqu3clD53LhMooGOQ8OdYyFFQSF4G1R-gD7rAGut8D6LelORtFOEkN9e0yf0wZbSX-EAGijpUPdo9cIwmbiaLg84-Z883EVxmqIKQ-30zb_hfceqdf0 Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:50:10.494627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e481023311984f5cb3388d7354d47fb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e481023311984f5cb3388d7354d47fb6"}]}] Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3deceff47f984622bce32990d5d5e599 Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-854773413", "metadata": {"Type": "work"}}} Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: Jul 20 17:50:10.510170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-854773413', 'metadata': {'Type': 'work'}}}} Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise error Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi '0' Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:10.511272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 17:50:10.513232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 17:50:10.514376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 17:50:10.514376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.514376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-76ee486f-1022-4779-ab10-a712369db417 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:10.514376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-76ee486f-1022-4779-ab10-a712369db417 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010557 Jul 20 17:50:10.514376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 53/107] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jul 20 17:50:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:50:10.515795 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f30004b4-a3b5-48e6-8a07-31bb1632a72b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:10.517938 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:10.522856 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f30004b4-a3b5-48e6-8a07-31bb1632a72b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.251053 Jul 20 17:50:10.533313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 55/108] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:10 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6e004e88-a166-42ba-9ca8-1816f282a375 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Action: 'create', calling method: .version_select at 0x7f7d3fecc790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1380110204", "metadata": {"Type": "work"}}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6e004e88-a166-42ba-9ca8-1816f282a375 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Request method failure captured: Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 119 Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EBR_z5FophUba4E347xOmWUCr4V_y1poRkGmg3_sj8Ro6RWlb9OCgaGwvmLsqu3clD53LhMooGOQ8OdYyFFQSF4G1R-gD7rAGut8D6LelORtFOEkN9e0yf0wZbSX-EAGijpUPdo9cIwmbiaLg84-Z883EVxmqIKQ-30zb_hfceqdf0 Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:50:10.533568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e481023311984f5cb3388d7354d47fb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e481023311984f5cb3388d7354d47fb6"}]}] Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3deceff47f984622bce32990d5d5e599 Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1380110204", "metadata": {"Type": "work"}}} Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: Jul 20 17:50:10.534880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1380110204', 'metadata': {'Type': 'work'}}}} Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise error Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi '' Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:10.535629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 17:50:10.536834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 17:50:10.537809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 17:50:10.537809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.537809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6e004e88-a166-42ba-9ca8-1816f282a375 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:10.537809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6e004e88-a166-42ba-9ca8-1816f282a375 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009007 Jul 20 17:50:10.537809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 54/109] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jul 20 17:50:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:50:10.544343 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bf7423a8-e1ad-44a1-8b9d-d2f3a43eeccc tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Calling method '.version_select at 0x7f7d3e487d30>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:10.577476 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-bf7423a8-e1ad-44a1-8b9d-d2f3a43eeccc tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] HTTP exception thrown: Volume tempest-invalid-22123875 could not be found. Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bf7423a8-e1ad-44a1-8b9d-d2f3a43eeccc tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Request method failure captured: Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-22123875 HTTP/1.1 Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EBR_z5FophUba4E347xOmWUCr4V_y1poRkGmg3_sj8Ro6RWlb9OCgaGwvmLsqu3clD53LhMooGOQ8OdYyFFQSF4G1R-gD7rAGut8D6LelORtFOEkN9e0yf0wZbSX-EAGijpUPdo9cIwmbiaLg84-Z883EVxmqIKQ-30zb_hfceqdf0 Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:50:10.579594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e481023311984f5cb3388d7354d47fb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e481023311984f5cb3388d7354d47fb6"}]}] Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3deceff47f984622bce32990d5d5e599 Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Volume tempest-invalid-22123875 could not be found. Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'tempest-invalid-22123875'} Jul 20 17:50:10.584276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-22123875 could not be found. (HTTP 404) (Request-ID: req-1c3dc917-54b5-4f3e-b917-f04486d8c6f5) Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.585316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 17:50:10.587072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-22123875 could not be found. Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:50:10.588645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-22123875 could not be found. Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-22123875 could not be found. Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bf7423a8-e1ad-44a1-8b9d-d2f3a43eeccc tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Returning 404 to user: Volume tempest-invalid-22123875 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bf7423a8-e1ad-44a1-8b9d-d2f3a43eeccc tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-22123875" status: 404 len: 97 microversion: 2.1 time: 0.041663 Jul 20 17:50:10.590364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 56/110] 10.222.0.42 () {58 vars in 1211 bytes} [Wed Jul 20 17:50:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-22123875 => generated 97 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 17:50:10.604481 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fad1bf34-82cf-45ed-b0f4-9ca37596fd80 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008548 Jul 20 17:50:10.604481 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 55/111] 10.222.0.42 () {58 vars in 1139 bytes} [Wed Jul 20 17:50:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 17:50:10.610655 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d2af1a56-3a7d-4fe3-a302-639f1b7bd63a tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003956 Jul 20 17:50:10.611153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 57/112] 10.222.0.42 () {58 vars in 1136 bytes} [Wed Jul 20 17:50:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 17:50:10.623477 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cd865dca-fc4a-49dd-a469-5acb64222e99 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Calling method '.version_select at 0x7f7d3dc31940>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:10.654365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-cd865dca-fc4a-49dd-a469-5acb64222e99 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] HTTP exception thrown: Volume 035e2177-f535-4365-be36-4368b1677d0d could not be found. Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cd865dca-fc4a-49dd-a469-5acb64222e99 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Request method failure captured: Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/os-volumes/035e2177-f535-4365-be36-4368b1677d0d HTTP/1.1 Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EBR_z5FophUba4E347xOmWUCr4V_y1poRkGmg3_sj8Ro6RWlb9OCgaGwvmLsqu3clD53LhMooGOQ8OdYyFFQSF4G1R-gD7rAGut8D6LelORtFOEkN9e0yf0wZbSX-EAGijpUPdo9cIwmbiaLg84-Z883EVxmqIKQ-30zb_hfceqdf0 Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:50:10.659512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e481023311984f5cb3388d7354d47fb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e481023311984f5cb3388d7354d47fb6"}]}] Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3deceff47f984622bce32990d5d5e599 Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Volume 035e2177-f535-4365-be36-4368b1677d0d could not be found. Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '035e2177-f535-4365-be36-4368b1677d0d'} Jul 20 17:50:10.660945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 035e2177-f535-4365-be36-4368b1677d0d could not be found. (HTTP 404) (Request-ID: req-70207b1c-d70e-444c-a8e4-e054192d32c4) Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.661863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 17:50:10.663471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 035e2177-f535-4365-be36-4368b1677d0d could not be found. Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 17:50:10.664425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 035e2177-f535-4365-be36-4368b1677d0d could not be found. Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 035e2177-f535-4365-be36-4368b1677d0d could not be found. Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cd865dca-fc4a-49dd-a469-5acb64222e99 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Returning 404 to user: Volume 035e2177-f535-4365-be36-4368b1677d0d could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cd865dca-fc4a-49dd-a469-5acb64222e99 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/035e2177-f535-4365-be36-4368b1677d0d" status: 404 len: 109 microversion: 2.1 time: 0.043769 Jul 20 17:50:10.666296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 56/113] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 17:50:10 2022] DELETE /compute/v2.1/os-volumes/035e2177-f535-4365-be36-4368b1677d0d => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:50:10.672057 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-17fec5e2-9559-4166-b8b6-58554e568130 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Calling method '.version_select at 0x7f7d3f67e0d0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:10.699708 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-17fec5e2-9559-4166-b8b6-58554e568130 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] HTTP exception thrown: Volume 38402a0b-84df-4b6a-8987-eea2de32e13b could not be found. Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-17fec5e2-9559-4166-b8b6-58554e568130 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Request method failure captured: Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/os-volumes/38402a0b-84df-4b6a-8987-eea2de32e13b HTTP/1.1 Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EBR_z5FophUba4E347xOmWUCr4V_y1poRkGmg3_sj8Ro6RWlb9OCgaGwvmLsqu3clD53LhMooGOQ8OdYyFFQSF4G1R-gD7rAGut8D6LelORtFOEkN9e0yf0wZbSX-EAGijpUPdo9cIwmbiaLg84-Z883EVxmqIKQ-30zb_hfceqdf0 Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:50:10.701915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e481023311984f5cb3388d7354d47fb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e481023311984f5cb3388d7354d47fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e481023311984f5cb3388d7354d47fb6"}]}] Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: e481023311984f5cb3388d7354d47fb6 Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesNegativeTest-1896299933 Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3deceff47f984622bce32990d5d5e599 Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesNegativeTest-1896299933-project Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Volume 38402a0b-84df-4b6a-8987-eea2de32e13b could not be found. Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '38402a0b-84df-4b6a-8987-eea2de32e13b'} Jul 20 17:50:10.703866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 38402a0b-84df-4b6a-8987-eea2de32e13b could not be found. (HTTP 404) (Request-ID: req-8cc0ef69-f35d-41b3-abe4-d2ccea5fcbc5) Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.704780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:50:10.706081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 38402a0b-84df-4b6a-8987-eea2de32e13b could not be found. Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 17:50:10.707522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 38402a0b-84df-4b6a-8987-eea2de32e13b could not be found. Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 38402a0b-84df-4b6a-8987-eea2de32e13b could not be found. Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-17fec5e2-9559-4166-b8b6-58554e568130 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] Returning 404 to user: Volume 38402a0b-84df-4b6a-8987-eea2de32e13b could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-17fec5e2-9559-4166-b8b6-58554e568130 tempest-VolumesNegativeTest-1896299933 tempest-VolumesNegativeTest-1896299933-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/38402a0b-84df-4b6a-8987-eea2de32e13b" status: 404 len: 109 microversion: 2.1 time: 0.036512 Jul 20 17:50:10.708891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 58/114] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:50:10 2022] GET /compute/v2.1/os-volumes/38402a0b-84df-4b6a-8987-eea2de32e13b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:50:11.269733 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:11.270475 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:11.278286 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:11.278742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:11.279495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:11.279923 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:11.291814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9d5ab47f-e7eb-4ab2-a6f0-654a776c2599 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:11.294101 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9d5ab47f-e7eb-4ab2-a6f0-654a776c2599 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:11.303485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d5ab47f-e7eb-4ab2-a6f0-654a776c2599 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:11.304368 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d5ab47f-e7eb-4ab2-a6f0-654a776c2599 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:11.306191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d5ab47f-e7eb-4ab2-a6f0-654a776c2599 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:11.312021 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d5ab47f-e7eb-4ab2-a6f0-654a776c2599 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:11.550769 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:11.559023 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:11.560567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:11.562337 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a312396a-46b9-4faa-a553-daa359f73fc4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.298193 Jul 20 17:50:11.563065 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 57/115] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:11 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:11.567588 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d457cae5-9156-4b08-8700-1b20e3478bf0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:11.568179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d457cae5-9156-4b08-8700-1b20e3478bf0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:11.574566 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d457cae5-9156-4b08-8700-1b20e3478bf0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:11.575191 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d457cae5-9156-4b08-8700-1b20e3478bf0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:11.576126 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d457cae5-9156-4b08-8700-1b20e3478bf0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:11.576973 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d457cae5-9156-4b08-8700-1b20e3478bf0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:11.580830 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d5ab47f-e7eb-4ab2-a6f0-654a776c2599 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:11.595996 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9d5ab47f-e7eb-4ab2-a6f0-654a776c2599 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.312025 Jul 20 17:50:11.597496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 59/116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:11 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:50:11.736691 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d457cae5-9156-4b08-8700-1b20e3478bf0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:11.740276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=100 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:11.744642 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d457cae5-9156-4b08-8700-1b20e3478bf0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.180456 Jul 20 17:50:11.745251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 58/117] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:11 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:12.580639 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-be9d3ab6-f696-4c82-afa9-270801609348 req-154aa7d0-80e6-485a-b253-d95ab3267c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b246c9-d9df-4348-9d5a-61c1170b1951", "name": "network-vif-plugged", "status": "completed", "tag": "c0861927-5eef-4dee-a02c-a3bed737a580"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:12.588763 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:12.589334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-be9d3ab6-f696-4c82-afa9-270801609348 req-154aa7d0-80e6-485a-b253-d95ab3267c78 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:12.589776 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-be9d3ab6-f696-4c82-afa9-270801609348 req-154aa7d0-80e6-485a-b253-d95ab3267c78 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:12.589928 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:12.597571 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:12.598078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:12.598853 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:12.599656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:12.601509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-be9d3ab6-f696-4c82-afa9-270801609348 req-154aa7d0-80e6-485a-b253-d95ab3267c78 service nova] Creating event network-vif-plugged:c0861927-5eef-4dee-a02c-a3bed737a580 for instance 45b246c9-d9df-4348-9d5a-61c1170b1951 on hv-cinder-84984 Jul 20 17:50:12.610259 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-be9d3ab6-f696-4c82-afa9-270801609348 req-154aa7d0-80e6-485a-b253-d95ab3267c78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168301 Jul 20 17:50:12.617273 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 60/118] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:50:12.631725 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b18e72e4-3fbf-47c4-a789-2624b9c0e8f4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:12.632540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b18e72e4-3fbf-47c4-a789-2624b9c0e8f4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:12.639400 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b18e72e4-3fbf-47c4-a789-2624b9c0e8f4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:12.639805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b18e72e4-3fbf-47c4-a789-2624b9c0e8f4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:12.640925 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b18e72e4-3fbf-47c4-a789-2624b9c0e8f4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:12.641531 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b18e72e4-3fbf-47c4-a789-2624b9c0e8f4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:12.851723 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:12.862816 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:12.864809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:12.866168 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7f6e8b4d-827a-4a66-8a0e-ea64c333bd35 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.289886 Jul 20 17:50:12.866955 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 59/119] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:12 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:50:12.884930 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b18e72e4-3fbf-47c4-a789-2624b9c0e8f4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:12.891256 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1a07a401-6571-4bea-8d0d-013d99dba102 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:12.893163 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1a07a401-6571-4bea-8d0d-013d99dba102 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:12.894338 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b18e72e4-3fbf-47c4-a789-2624b9c0e8f4 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.271879 Jul 20 17:50:12.897961 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 61/120] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:12 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:12.900514 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a07a401-6571-4bea-8d0d-013d99dba102 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:12.901503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a07a401-6571-4bea-8d0d-013d99dba102 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:12.902917 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a07a401-6571-4bea-8d0d-013d99dba102 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:12.903502 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a07a401-6571-4bea-8d0d-013d99dba102 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:13.081512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1a07a401-6571-4bea-8d0d-013d99dba102 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:13.089178 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1a07a401-6571-4bea-8d0d-013d99dba102 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.201741 Jul 20 17:50:13.089752 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 60/121] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:12 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:13.884909 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:13.885551 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:13.892085 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:13.892561 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:13.893318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:13.893748 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:13.912319 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5e1aebbd-a71e-41d6-849d-15901b6c222d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:13.912974 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5e1aebbd-a71e-41d6-849d-15901b6c222d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:13.919100 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e1aebbd-a71e-41d6-849d-15901b6c222d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:13.919691 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e1aebbd-a71e-41d6-849d-15901b6c222d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:13.920459 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e1aebbd-a71e-41d6-849d-15901b6c222d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:13.920950 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e1aebbd-a71e-41d6-849d-15901b6c222d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:14.097793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5e1aebbd-a71e-41d6-849d-15901b6c222d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:14.100993 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:14.107185 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5e1aebbd-a71e-41d6-849d-15901b6c222d tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.198426 Jul 20 17:50:14.107923 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 61/122] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:13 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:50:14.110864 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:14.112585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:14.113698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f8a7c1f0-8fe8-4f61-8cd8-23c228145ea3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:14.114114 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d974f648-01e0-4b94-9414-da2e5eee026c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.232931 Jul 20 17:50:14.114299 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f8a7c1f0-8fe8-4f61-8cd8-23c228145ea3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:14.114798 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 62/123] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:13 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:14.120671 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f8a7c1f0-8fe8-4f61-8cd8-23c228145ea3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:14.121116 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f8a7c1f0-8fe8-4f61-8cd8-23c228145ea3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:14.121867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f8a7c1f0-8fe8-4f61-8cd8-23c228145ea3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:14.122297 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f8a7c1f0-8fe8-4f61-8cd8-23c228145ea3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:14.247910 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f8a7c1f0-8fe8-4f61-8cd8-23c228145ea3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:14.255889 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f8a7c1f0-8fe8-4f61-8cd8-23c228145ea3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.145843 Jul 20 17:50:14.256468 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 62/124] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:14 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:14.628083 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-acd22d32-4657-49f5-963e-e3e35aad7238 req-0e383256-4941-42e1-a0c0-e4a9d596d90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7911d50-9baa-455c-8821-9167e6f35b4d", "name": "network-vif-plugged", "status": "completed", "tag": "64ac2385-a271-4bc9-98e9-b7149eb12088"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:14.636350 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-acd22d32-4657-49f5-963e-e3e35aad7238 req-0e383256-4941-42e1-a0c0-e4a9d596d90d service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:14.648016 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-acd22d32-4657-49f5-963e-e3e35aad7238 req-0e383256-4941-42e1-a0c0-e4a9d596d90d service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:14.648016 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-acd22d32-4657-49f5-963e-e3e35aad7238 req-0e383256-4941-42e1-a0c0-e4a9d596d90d service nova] Creating event network-vif-plugged:64ac2385-a271-4bc9-98e9-b7149eb12088 for instance f7911d50-9baa-455c-8821-9167e6f35b4d on hv-cinder-84984 Jul 20 17:50:14.653015 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-acd22d32-4657-49f5-963e-e3e35aad7238 req-0e383256-4941-42e1-a0c0-e4a9d596d90d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028375 Jul 20 17:50:14.653528 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 63/125] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:50:15.124385 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b539880e-2215-4358-bf36-44563867e67f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:15.128733 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b539880e-2215-4358-bf36-44563867e67f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:15.131562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b539880e-2215-4358-bf36-44563867e67f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:15.132013 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b539880e-2215-4358-bf36-44563867e67f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:15.132827 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b539880e-2215-4358-bf36-44563867e67f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:15.133191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:15.133632 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b539880e-2215-4358-bf36-44563867e67f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:15.133905 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:15.140616 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:15.141062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:15.141814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:15.142240 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:15.330796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b539880e-2215-4358-bf36-44563867e67f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:15.335960 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:15.341043 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b539880e-2215-4358-bf36-44563867e67f tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.220295 Jul 20 17:50:15.341883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 63/126] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:15 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:15.346735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-77c8bb7d-1c34-4b97-928b-c172c575ed19 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:15.347267 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:15.347380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-77c8bb7d-1c34-4b97-928b-c172c575ed19 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:15.348955 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:15.350093 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6bee23e2-414c-4e76-a3ef-41477321dac4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.221449 Jul 20 17:50:15.350975 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 64/127] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:15 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:50:15.353336 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-77c8bb7d-1c34-4b97-928b-c172c575ed19 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:15.353777 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-77c8bb7d-1c34-4b97-928b-c172c575ed19 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:15.354525 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-77c8bb7d-1c34-4b97-928b-c172c575ed19 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:15.354952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-77c8bb7d-1c34-4b97-928b-c172c575ed19 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:15.512117 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-77c8bb7d-1c34-4b97-928b-c172c575ed19 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:15.520752 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-77c8bb7d-1c34-4b97-928b-c172c575ed19 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.177662 Jul 20 17:50:15.521878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 64/128] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:15 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:16.378184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-74108d7d-b70a-4a8d-b6a7-47bd8d032f64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:16.378184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-74108d7d-b70a-4a8d-b6a7-47bd8d032f64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:16.379654 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:16.380389 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:16.389304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:16.392058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-74108d7d-b70a-4a8d-b6a7-47bd8d032f64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:16.399796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:16.402293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-74108d7d-b70a-4a8d-b6a7-47bd8d032f64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:16.403124 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-74108d7d-b70a-4a8d-b6a7-47bd8d032f64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:16.403660 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-74108d7d-b70a-4a8d-b6a7-47bd8d032f64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:16.409688 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:16.410189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:16.635560 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-74108d7d-b70a-4a8d-b6a7-47bd8d032f64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:16.646034 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-74108d7d-b70a-4a8d-b6a7-47bd8d032f64 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.289559 Jul 20 17:50:16.651577 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:16.657407 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 65/129] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:16 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:16.663951 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8997d3b9-1146-4462-b501-86cb58e626cd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:16.664919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8997d3b9-1146-4462-b501-86cb58e626cd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:16.675305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8997d3b9-1146-4462-b501-86cb58e626cd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:16.675922 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8997d3b9-1146-4462-b501-86cb58e626cd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:16.676928 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8997d3b9-1146-4462-b501-86cb58e626cd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:16.677502 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8997d3b9-1146-4462-b501-86cb58e626cd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:16.679967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:16.684673 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:16.690714 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f7e2c65c-2987-49f7-8820-36da9798f8d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.325415 Jul 20 17:50:16.691300 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 65/130] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:16 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:16.820735 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8997d3b9-1146-4462-b501-86cb58e626cd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:16.828922 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8997d3b9-1146-4462-b501-86cb58e626cd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.169698 Jul 20 17:50:16.829504 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 66/131] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:16 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:17.663078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7a4e6f8e-8c49-486c-a8ec-a2161684e5b2 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:17.663868 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7a4e6f8e-8c49-486c-a8ec-a2161684e5b2 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:17.670265 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7a4e6f8e-8c49-486c-a8ec-a2161684e5b2 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:17.671590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7a4e6f8e-8c49-486c-a8ec-a2161684e5b2 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:17.672370 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7a4e6f8e-8c49-486c-a8ec-a2161684e5b2 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:17.672834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7a4e6f8e-8c49-486c-a8ec-a2161684e5b2 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:17.711312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:17.712309 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:17.721194 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:17.723636 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:17.724491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:17.725134 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:17.875340 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7a4e6f8e-8c49-486c-a8ec-a2161684e5b2 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:17.884167 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7a4e6f8e-8c49-486c-a8ec-a2161684e5b2 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1314 microversion: 2.1 time: 0.224602 Jul 20 17:50:17.885349 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 66/132] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:17 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:17.894185 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-f1ea8c7c-688f-4462-8708-2def0b909cdb req-8e673ac1-37ad-4c23-9dce-10b94439b2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a9d731-6fac-4e62-a247-194eb02970a2", "name": "network-vif-plugged", "status": "completed", "tag": "b4d1a842-ac4e-4cea-b6c2-edcf4932e3d1"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:17.903613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-f1ea8c7c-688f-4462-8708-2def0b909cdb req-8e673ac1-37ad-4c23-9dce-10b94439b2f9 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:17.904811 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-f1ea8c7c-688f-4462-8708-2def0b909cdb req-8e673ac1-37ad-4c23-9dce-10b94439b2f9 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:17.919699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-f1ea8c7c-688f-4462-8708-2def0b909cdb req-8e673ac1-37ad-4c23-9dce-10b94439b2f9 service nova] Creating event network-vif-plugged:b4d1a842-ac4e-4cea-b6c2-edcf4932e3d1 for instance b8a9d731-6fac-4e62-a247-194eb02970a2 on hv-cinder-84984 Jul 20 17:50:17.926276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-f1ea8c7c-688f-4462-8708-2def0b909cdb req-8e673ac1-37ad-4c23-9dce-10b94439b2f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039140 Jul 20 17:50:17.928046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 67/133] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:50:17.934988 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-da4b3d56-545f-481a-b3cf-217509dea247 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:17.935835 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-da4b3d56-545f-481a-b3cf-217509dea247 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:17.938698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:17.943542 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da4b3d56-545f-481a-b3cf-217509dea247 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:17.943996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da4b3d56-545f-481a-b3cf-217509dea247 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:17.944791 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da4b3d56-545f-481a-b3cf-217509dea247 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:17.945249 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da4b3d56-545f-481a-b3cf-217509dea247 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:17.955701 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:17.957242 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:17.958449 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5c77d70e-5f2f-4d20-a7da-1ecc2e412822 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1408 microversion: 2.20 time: 0.253822 Jul 20 17:50:17.987525 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 67/134] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:17 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:50:18.118193 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-da4b3d56-545f-481a-b3cf-217509dea247 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:18.126532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-da4b3d56-545f-481a-b3cf-217509dea247 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.197400 Jul 20 17:50:18.127710 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 68/135] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:17 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:18.901751 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-110284e0-22b1-4191-a91a-4bb145260eb7 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:18.902362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-110284e0-22b1-4191-a91a-4bb145260eb7 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:18.908590 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-110284e0-22b1-4191-a91a-4bb145260eb7 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:18.909038 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-110284e0-22b1-4191-a91a-4bb145260eb7 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:18.909798 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-110284e0-22b1-4191-a91a-4bb145260eb7 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:18.910230 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-110284e0-22b1-4191-a91a-4bb145260eb7 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:18.982540 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:18.983503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:19.010298 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:19.011764 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:19.016663 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:19.017274 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:19.069037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-110284e0-22b1-4191-a91a-4bb145260eb7 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:19.078070 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-110284e0-22b1-4191-a91a-4bb145260eb7 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1501 microversion: 2.1 time: 0.179430 Jul 20 17:50:19.078440 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 68/136] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:18 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:19.153955 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-477b3056-33c3-48fc-9f60-a77712af7db8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:19.155676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-477b3056-33c3-48fc-9f60-a77712af7db8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:19.162679 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-477b3056-33c3-48fc-9f60-a77712af7db8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:19.163426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-477b3056-33c3-48fc-9f60-a77712af7db8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:19.165168 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-477b3056-33c3-48fc-9f60-a77712af7db8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:19.167028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-477b3056-33c3-48fc-9f60-a77712af7db8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:19.185688 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:19.194727 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:19.196284 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:19.197502 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2b386090-d88a-4296-9519-43e0ca3d8c7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1599 microversion: 2.20 time: 0.220421 Jul 20 17:50:19.198563 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 69/137] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:50:18 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:50:19.221622 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9dcf8e1b-2626-4212-a559-e16bf9cf797f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:19.222180 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9dcf8e1b-2626-4212-a559-e16bf9cf797f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:19.228521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9dcf8e1b-2626-4212-a559-e16bf9cf797f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:19.229296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9dcf8e1b-2626-4212-a559-e16bf9cf797f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:19.230060 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9dcf8e1b-2626-4212-a559-e16bf9cf797f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:19.233752 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9dcf8e1b-2626-4212-a559-e16bf9cf797f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:19.340338 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-477b3056-33c3-48fc-9f60-a77712af7db8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:19.348340 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-477b3056-33c3-48fc-9f60-a77712af7db8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.199378 Jul 20 17:50:19.348948 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 69/138] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:19 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:50:19.360043 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9dcf8e1b-2626-4212-a559-e16bf9cf797f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.142714 Jul 20 17:50:19.360756 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 70/139] 10.222.0.42 () {60 vars in 1315 bytes} [Wed Jul 20 17:50:19 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 17:50:20.364734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1366e420-d52c-4e3a-9254-24d03c8f15c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:20.365374 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1366e420-d52c-4e3a-9254-24d03c8f15c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:20.371344 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1366e420-d52c-4e3a-9254-24d03c8f15c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:20.371789 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1366e420-d52c-4e3a-9254-24d03c8f15c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:20.372574 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1366e420-d52c-4e3a-9254-24d03c8f15c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:20.373006 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1366e420-d52c-4e3a-9254-24d03c8f15c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:20.598033 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1366e420-d52c-4e3a-9254-24d03c8f15c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:20.605724 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1366e420-d52c-4e3a-9254-24d03c8f15c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.244898 Jul 20 17:50:20.606292 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 70/140] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:20 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:20.959716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-331a1ed1-b2fe-434b-8087-83cc49817ec8 req-c21cb838-dc4b-47e4-bb5d-f3a3fe7e0575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b246c9-d9df-4348-9d5a-61c1170b1951", "tag": "c0861927-5eef-4dee-a02c-a3bed737a580"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:20.968317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-331a1ed1-b2fe-434b-8087-83cc49817ec8 req-c21cb838-dc4b-47e4-bb5d-f3a3fe7e0575 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:20.968775 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-331a1ed1-b2fe-434b-8087-83cc49817ec8 req-c21cb838-dc4b-47e4-bb5d-f3a3fe7e0575 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:20.979569 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-331a1ed1-b2fe-434b-8087-83cc49817ec8 req-c21cb838-dc4b-47e4-bb5d-f3a3fe7e0575 service nova] Creating event network-changed:c0861927-5eef-4dee-a02c-a3bed737a580 for instance 45b246c9-d9df-4348-9d5a-61c1170b1951 on hv-cinder-84984 Jul 20 17:50:20.984586 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-331a1ed1-b2fe-434b-8087-83cc49817ec8 req-c21cb838-dc4b-47e4-bb5d-f3a3fe7e0575 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028494 Jul 20 17:50:20.985172 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 71/141] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:50:21.622921 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fb9e6736-2c8e-4249-96f1-68d5b316da2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:21.623448 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fb9e6736-2c8e-4249-96f1-68d5b316da2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:21.633260 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fb9e6736-2c8e-4249-96f1-68d5b316da2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:21.633260 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fb9e6736-2c8e-4249-96f1-68d5b316da2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:21.633260 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fb9e6736-2c8e-4249-96f1-68d5b316da2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:21.633260 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fb9e6736-2c8e-4249-96f1-68d5b316da2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:21.793408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fb9e6736-2c8e-4249-96f1-68d5b316da2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:21.801395 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fb9e6736-2c8e-4249-96f1-68d5b316da2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.182506 Jul 20 17:50:21.806643 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 71/142] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:21 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:22.826474 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fffcf047-edf2-49fb-99c3-dbc500198b5f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:22.827869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fffcf047-edf2-49fb-99c3-dbc500198b5f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:22.834322 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fffcf047-edf2-49fb-99c3-dbc500198b5f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:22.834705 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fffcf047-edf2-49fb-99c3-dbc500198b5f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:22.835448 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fffcf047-edf2-49fb-99c3-dbc500198b5f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:22.835878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fffcf047-edf2-49fb-99c3-dbc500198b5f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:22.966892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fffcf047-edf2-49fb-99c3-dbc500198b5f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:22.974678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fffcf047-edf2-49fb-99c3-dbc500198b5f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.152550 Jul 20 17:50:22.977046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 72/143] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:22 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:23.991943 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e8eac776-7b28-4d0d-9f12-4dab90e2e033 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:23.993409 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e8eac776-7b28-4d0d-9f12-4dab90e2e033 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:24.001010 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e8eac776-7b28-4d0d-9f12-4dab90e2e033 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:24.001519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e8eac776-7b28-4d0d-9f12-4dab90e2e033 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:24.003917 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e8eac776-7b28-4d0d-9f12-4dab90e2e033 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:24.004321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e8eac776-7b28-4d0d-9f12-4dab90e2e033 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:24.331276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e8eac776-7b28-4d0d-9f12-4dab90e2e033 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:24.338650 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e8eac776-7b28-4d0d-9f12-4dab90e2e033 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1367 microversion: 2.1 time: 0.351417 Jul 20 17:50:24.339350 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 72/144] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:23 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:50:24.683626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3d0b3055-1462-4cd5-a650-6a9a28fb5ca1 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4f61ba9-605b-48c1-98d0-106c99cf9e33"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:24.685802 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3d0b3055-1462-4cd5-a650-6a9a28fb5ca1 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:24.692055 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3d0b3055-1462-4cd5-a650-6a9a28fb5ca1 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:24.692578 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3d0b3055-1462-4cd5-a650-6a9a28fb5ca1 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:24.693345 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3d0b3055-1462-4cd5-a650-6a9a28fb5ca1 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:24.693770 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3d0b3055-1462-4cd5-a650-6a9a28fb5ca1 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:25.355724 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c6f84e07-381e-4445-883e-4df8618a70a0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:25.356331 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c6f84e07-381e-4445-883e-4df8618a70a0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:25.362817 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6f84e07-381e-4445-883e-4df8618a70a0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:25.363262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6f84e07-381e-4445-883e-4df8618a70a0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:25.364023 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6f84e07-381e-4445-883e-4df8618a70a0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:25.364469 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c6f84e07-381e-4445-883e-4df8618a70a0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:25.521703 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c6f84e07-381e-4445-883e-4df8618a70a0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:25.530932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c6f84e07-381e-4445-883e-4df8618a70a0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1557 microversion: 2.1 time: 0.178901 Jul 20 17:50:25.531599 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 73/145] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:25 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1557 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:50:25.541818 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3d0b3055-1462-4cd5-a650-6a9a28fb5ca1 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "POST /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863289 Jul 20 17:50:25.542913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 73/146] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:50:24 2022] POST /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d/os-volume_attachments => generated 194 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:50:25.553733 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ac2249ab-4043-40bb-9b42-07ebee3fd3e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:25.554398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ac2249ab-4043-40bb-9b42-07ebee3fd3e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:25.583677 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac2249ab-4043-40bb-9b42-07ebee3fd3e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:25.585678 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac2249ab-4043-40bb-9b42-07ebee3fd3e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:25.586681 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac2249ab-4043-40bb-9b42-07ebee3fd3e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:25.588521 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac2249ab-4043-40bb-9b42-07ebee3fd3e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:25.737970 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ac2249ab-4043-40bb-9b42-07ebee3fd3e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188940 Jul 20 17:50:25.738683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 74/147] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jul 20 17:50:25 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:50:26.862632 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-06f94eb2-8496-4cbe-8992-23134f2e94ad req-d4d875b7-99d3-44db-914f-2a5a88723e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a9d731-6fac-4e62-a247-194eb02970a2", "tag": "b4d1a842-ac4e-4cea-b6c2-edcf4932e3d1"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:26.870318 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=76 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:26.872591 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-06f94eb2-8496-4cbe-8992-23134f2e94ad req-d4d875b7-99d3-44db-914f-2a5a88723e34 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:26.873036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-06f94eb2-8496-4cbe-8992-23134f2e94ad req-d4d875b7-99d3-44db-914f-2a5a88723e34 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:26.884942 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-06f94eb2-8496-4cbe-8992-23134f2e94ad req-d4d875b7-99d3-44db-914f-2a5a88723e34 service nova] Creating event network-changed:b4d1a842-ac4e-4cea-b6c2-edcf4932e3d1 for instance b8a9d731-6fac-4e62-a247-194eb02970a2 on hv-cinder-84984 Jul 20 17:50:26.889995 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-06f94eb2-8496-4cbe-8992-23134f2e94ad req-d4d875b7-99d3-44db-914f-2a5a88723e34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031869 Jul 20 17:50:26.890588 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 74/148] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:50:36.552049 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=37 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:36.557022 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=86 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:36.557467 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f6170c80-0e4d-4357-a5b0-adb11647fedb tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:36.557629 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f6170c80-0e4d-4357-a5b0-adb11647fedb tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:36.565185 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6170c80-0e4d-4357-a5b0-adb11647fedb tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:36.565628 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6170c80-0e4d-4357-a5b0-adb11647fedb tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:36.566397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6170c80-0e4d-4357-a5b0-adb11647fedb tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:36.566827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6170c80-0e4d-4357-a5b0-adb11647fedb tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:36.595947 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f6170c80-0e4d-4357-a5b0-adb11647fedb tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:50:37.036728 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f6170c80-0e4d-4357-a5b0-adb11647fedb tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 204 len: 0 microversion: 2.1 time: 0.485615 Jul 20 17:50:37.037329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 75/149] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:50:36 2022] DELETE /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:50:37.048491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:37.054030 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6a3c49c6-d376-4fdc-829b-cf6a0952aad0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:37.055121 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6a3c49c6-d376-4fdc-829b-cf6a0952aad0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:37.064102 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6a3c49c6-d376-4fdc-829b-cf6a0952aad0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:37.064855 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6a3c49c6-d376-4fdc-829b-cf6a0952aad0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:37.065740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6a3c49c6-d376-4fdc-829b-cf6a0952aad0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:37.066184 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6a3c49c6-d376-4fdc-829b-cf6a0952aad0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:37.219042 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6a3c49c6-d376-4fdc-829b-cf6a0952aad0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:37.227447 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6a3c49c6-d376-4fdc-829b-cf6a0952aad0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1553 microversion: 2.1 time: 0.180551 Jul 20 17:50:37.228026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 75/150] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:37 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:38.245674 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ba26afbe-0565-47ee-b0f4-d5ca67131266 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:38.246396 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ba26afbe-0565-47ee-b0f4-d5ca67131266 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:38.253022 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba26afbe-0565-47ee-b0f4-d5ca67131266 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:38.253459 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba26afbe-0565-47ee-b0f4-d5ca67131266 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:38.254300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba26afbe-0565-47ee-b0f4-d5ca67131266 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:38.254726 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba26afbe-0565-47ee-b0f4-d5ca67131266 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:38.396994 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ba26afbe-0565-47ee-b0f4-d5ca67131266 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:38.409315 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ba26afbe-0565-47ee-b0f4-d5ca67131266 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1553 microversion: 2.1 time: 0.167714 Jul 20 17:50:38.409971 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 76/151] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:38 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:39.428944 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0d466bde-dc8a-4ee8-89c7-f56fb01dc032 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:39.429555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0d466bde-dc8a-4ee8-89c7-f56fb01dc032 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:39.437073 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0d466bde-dc8a-4ee8-89c7-f56fb01dc032 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:39.437518 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0d466bde-dc8a-4ee8-89c7-f56fb01dc032 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:39.438271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0d466bde-dc8a-4ee8-89c7-f56fb01dc032 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:39.443259 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0d466bde-dc8a-4ee8-89c7-f56fb01dc032 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:39.572071 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0d466bde-dc8a-4ee8-89c7-f56fb01dc032 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:39.580152 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0d466bde-dc8a-4ee8-89c7-f56fb01dc032 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1553 microversion: 2.1 time: 0.155416 Jul 20 17:50:39.580800 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 76/152] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:39 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:40.602471 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-105c0dd2-ac0f-49c8-97fe-9501ddcee8d8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:40.603096 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-105c0dd2-ac0f-49c8-97fe-9501ddcee8d8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:40.614777 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-105c0dd2-ac0f-49c8-97fe-9501ddcee8d8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:40.615204 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-105c0dd2-ac0f-49c8-97fe-9501ddcee8d8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:40.615993 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-105c0dd2-ac0f-49c8-97fe-9501ddcee8d8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:40.616412 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-105c0dd2-ac0f-49c8-97fe-9501ddcee8d8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:40.809701 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-105c0dd2-ac0f-49c8-97fe-9501ddcee8d8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:40.817610 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-105c0dd2-ac0f-49c8-97fe-9501ddcee8d8 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1553 microversion: 2.1 time: 0.219833 Jul 20 17:50:40.818254 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 77/153] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:40 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:41.835219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-12514edf-0d8a-4512-9407-14c46cc9ec76 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:41.836419 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-12514edf-0d8a-4512-9407-14c46cc9ec76 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:41.846872 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12514edf-0d8a-4512-9407-14c46cc9ec76 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:41.848634 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12514edf-0d8a-4512-9407-14c46cc9ec76 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:41.850895 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12514edf-0d8a-4512-9407-14c46cc9ec76 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:41.852289 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12514edf-0d8a-4512-9407-14c46cc9ec76 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:42.063460 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-12514edf-0d8a-4512-9407-14c46cc9ec76 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:42.073039 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-12514edf-0d8a-4512-9407-14c46cc9ec76 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1553 microversion: 2.1 time: 0.241918 Jul 20 17:50:42.073691 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 77/154] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:41 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:50:42.945395 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-f2734c70-c218-4e2f-b9ff-1e63cfd2f8d9 req-d5a97c45-2b8a-4745-a8de-04903dc59e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7911d50-9baa-455c-8821-9167e6f35b4d", "name": "network-vif-deleted", "tag": "64ac2385-a271-4bc9-98e9-b7149eb12088"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:42.956017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f2734c70-c218-4e2f-b9ff-1e63cfd2f8d9 req-d5a97c45-2b8a-4745-a8de-04903dc59e66 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:42.956484 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f2734c70-c218-4e2f-b9ff-1e63cfd2f8d9 req-d5a97c45-2b8a-4745-a8de-04903dc59e66 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:42.968770 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-f2734c70-c218-4e2f-b9ff-1e63cfd2f8d9 req-d5a97c45-2b8a-4745-a8de-04903dc59e66 service nova] Creating event network-vif-deleted:64ac2385-a271-4bc9-98e9-b7149eb12088 for instance f7911d50-9baa-455c-8821-9167e6f35b4d on hv-cinder-84984 Jul 20 17:50:42.973923 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-f2734c70-c218-4e2f-b9ff-1e63cfd2f8d9 req-d5a97c45-2b8a-4745-a8de-04903dc59e66 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032152 Jul 20 17:50:42.974591 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 78/155] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:50:43.090809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f97f3268-67b7-4db5-928b-5d3a401d49fe tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:43.091735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f97f3268-67b7-4db5-928b-5d3a401d49fe tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:43.118449 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f97f3268-67b7-4db5-928b-5d3a401d49fe tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:43.118892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f97f3268-67b7-4db5-928b-5d3a401d49fe tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:43.119660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f97f3268-67b7-4db5-928b-5d3a401d49fe tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:43.120616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f97f3268-67b7-4db5-928b-5d3a401d49fe tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:43.198027 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f97f3268-67b7-4db5-928b-5d3a401d49fe tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:43.207770 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f97f3268-67b7-4db5-928b-5d3a401d49fe tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1345 microversion: 2.1 time: 0.120578 Jul 20 17:50:43.208350 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 78/156] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:43 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:44.227093 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:44.228088 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:44.236334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:44.236812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:44.237571 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:44.238306 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:44.271054 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:44.271503 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:44.272145 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lazy-loading 'fault' on Instance uuid f7911d50-9baa-455c-8821-9167e6f35b4d {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:50:44.348068 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137e21587db048529f771d750da5b208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a76562649474d5bb8f326aab70630ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:44.358630 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-26948b3a-ece9-4139-8a28-73bdafbb584e tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 200 len: 1350 microversion: 2.1 time: 0.136007 Jul 20 17:50:44.359205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 79/157] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:44 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:45.375592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:45.376403 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:45.382872 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:45.383388 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:45.384211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:45.384669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:45.402990 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] HTTP exception thrown: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Request method failure captured: Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d HTTP/1.1 Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAutEOElVGMv0c9fNIzEet4rb7U0L87oavEA5JHinUMkz_5-SdeAtoxGtBgYLzSvSv_tvXGV8kLCZiffY3CAAkWz1RajJtu5zYww1Pa07pSZIM9Omzp26OUuZuJ5r5HN7iUFL5o6frzj-AjcoTZeX58prqPhy1rG8CxXLuGv87_msc Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 6a76562649474d5bb8f326aab70630ab Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:50:45.414804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6a76562649474d5bb8f326aab70630ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a76562649474d5bb8f326aab70630ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a76562649474d5bb8f326aab70630ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6a76562649474d5bb8f326aab70630ab"}]}] Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 6a76562649474d5bb8f326aab70630ab Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-DeleteServersTestJSON-1880138492-project Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 137e21587db048529f771d750da5b208 Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-DeleteServersTestJSON-1880138492-project Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.416280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'f7911d50-9baa-455c-8821-9167e6f35b4d'} Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:45.417144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.418559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.419643 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Returning 404 to user: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:45.419643 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0441cbec-4276-4612-8a0c-299a04802e99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 404 len: 111 microversion: 2.1 time: 0.045068 Jul 20 17:50:45.419991 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 79/158] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:45 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:50:45.529055 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:45.529920 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:45.535950 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:45.536422 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:45.537484 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:45.537601 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:45.553477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] HTTP exception thrown: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Request method failure captured: Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d/os-volume_attachments HTTP/1.1 Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAutEOElVGMv0c9fNIzEet4rb7U0L87oavEA5JHinUMkz_5-SdeAtoxGtBgYLzSvSv_tvXGV8kLCZiffY3CAAkWz1RajJtu5zYww1Pa07pSZIM9Omzp26OUuZuJ5r5HN7iUFL5o6frzj-AjcoTZeX58prqPhy1rG8CxXLuGv87_msc Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 6a76562649474d5bb8f326aab70630ab Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:50:45.558527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6a76562649474d5bb8f326aab70630ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a76562649474d5bb8f326aab70630ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a76562649474d5bb8f326aab70630ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6a76562649474d5bb8f326aab70630ab"}]}] Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 6a76562649474d5bb8f326aab70630ab Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-DeleteServersTestJSON-1880138492-project Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 137e21587db048529f771d750da5b208 Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-DeleteServersTestJSON-1880138492-project Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.560231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'server_id': 'f7911d50-9baa-455c-8821-9167e6f35b4d'} Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:45.562046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:45.563321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:45.565340 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Returning 404 to user: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:45.566261 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8ceda8d1-6fba-4802-bc12-b30f278e9f99 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043486 Jul 20 17:50:45.567088 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 80/159] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:50:45 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:50:45.959974 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-4286284", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:46.022018 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] validate_networks() for None {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:50:46.343028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:50:46.343471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:50:46.343975 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:50:46.344404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:50:46.344859 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:50:46.359179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:46.359179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:46.359179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:46.359179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:46.374279 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Getting quotas for project 0bcdae79468045d0b5d773d8caf238e6. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:50:46.393602 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Getting quotas for user 694570bd24c74fd19e80bd822048067b and project 0bcdae79468045d0b5d773d8caf238e6. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:50:46.402067 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:50:46.404729 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:50:46.536920 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-59d404bc-73fc-4214-84d2-d20f92f359e6 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579357 Jul 20 17:50:46.536920 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 80/160] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:50:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:50:46.547703 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-25b1278f-6cfd-4d90-b62c-5eac58b4e6fd tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:46.548373 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-25b1278f-6cfd-4d90-b62c-5eac58b4e6fd tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:46.608941 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-25b1278f-6cfd-4d90-b62c-5eac58b4e6fd tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:46.617516 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-25b1278f-6cfd-4d90-b62c-5eac58b4e6fd tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1212 microversion: 2.1 time: 0.073740 Jul 20 17:50:46.618282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 81/161] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:46 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1212 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:47.004318 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:47.004834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:47.014334 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:47.014780 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:47.015556 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:47.016008 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:47.030601 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] HTTP exception thrown: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Request method failure captured: Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d HTTP/1.1 Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAutEOElVGMv0c9fNIzEet4rb7U0L87oavEA5JHinUMkz_5-SdeAtoxGtBgYLzSvSv_tvXGV8kLCZiffY3CAAkWz1RajJtu5zYww1Pa07pSZIM9Omzp26OUuZuJ5r5HN7iUFL5o6frzj-AjcoTZeX58prqPhy1rG8CxXLuGv87_msc Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 6a76562649474d5bb8f326aab70630ab Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:50:47.032311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6a76562649474d5bb8f326aab70630ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a76562649474d5bb8f326aab70630ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a76562649474d5bb8f326aab70630ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6a76562649474d5bb8f326aab70630ab"}]}] Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 6a76562649474d5bb8f326aab70630ab Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-DeleteServersTestJSON-1880138492-project Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 137e21587db048529f771d750da5b208 Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-DeleteServersTestJSON-1880138492-project Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.033665 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'f7911d50-9baa-455c-8821-9167e6f35b4d'} Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:47.034304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.035343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.037198 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Returning 404 to user: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:47.038157 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ea53795f-8732-4811-9284-8c1801ab6a11 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 404 len: 111 microversion: 2.1 time: 0.037822 Jul 20 17:50:47.038948 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 81/162] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:50:46 2022] DELETE /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:50:47.047219 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:47.052710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] [instance: f7911d50-9baa-455c-8821-9167e6f35b4d] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:47.064614 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:47.065074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:47.065861 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:47.066304 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:47.081472 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] HTTP exception thrown: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Request method failure captured: Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d HTTP/1.1 Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAutEOElVGMv0c9fNIzEet4rb7U0L87oavEA5JHinUMkz_5-SdeAtoxGtBgYLzSvSv_tvXGV8kLCZiffY3CAAkWz1RajJtu5zYww1Pa07pSZIM9Omzp26OUuZuJ5r5HN7iUFL5o6frzj-AjcoTZeX58prqPhy1rG8CxXLuGv87_msc Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 6a76562649474d5bb8f326aab70630ab Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:50:47.083665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6a76562649474d5bb8f326aab70630ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a76562649474d5bb8f326aab70630ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a76562649474d5bb8f326aab70630ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6a76562649474d5bb8f326aab70630ab"}]}] Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 6a76562649474d5bb8f326aab70630ab Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-DeleteServersTestJSON-1880138492 Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-DeleteServersTestJSON-1880138492-project Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 137e21587db048529f771d750da5b208 Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-DeleteServersTestJSON-1880138492-project Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.084838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'f7911d50-9baa-455c-8821-9167e6f35b4d'} Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:50:47.085666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. Jul 20 17:50:47.087759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:50:47.089415 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] Returning 404 to user: Instance f7911d50-9baa-455c-8821-9167e6f35b4d could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:50:47.089415 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c79c380b-0a38-4727-8a21-50e42a7077e0 tempest-DeleteServersTestJSON-1880138492 tempest-DeleteServersTestJSON-1880138492-project] 10.222.0.42 "GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d" status: 404 len: 111 microversion: 2.1 time: 0.042315 Jul 20 17:50:47.089415 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 82/163] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:47 2022] GET /compute/v2.1/servers/f7911d50-9baa-455c-8821-9167e6f35b4d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:50:47.635013 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1f873c24-9826-4f4e-9a42-26b10e3373e2 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:47.635621 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1f873c24-9826-4f4e-9a42-26b10e3373e2 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:47.891986 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1f873c24-9826-4f4e-9a42-26b10e3373e2 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:47.901672 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1f873c24-9826-4f4e-9a42-26b10e3373e2 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1212 microversion: 2.1 time: 0.268958 Jul 20 17:50:47.902275 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 82/164] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:47 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1212 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:48.918301 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9acec317-dfd7-45eb-9c79-07addba53220 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:48.919553 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9acec317-dfd7-45eb-9c79-07addba53220 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:48.926826 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9acec317-dfd7-45eb-9c79-07addba53220 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:48.927541 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9acec317-dfd7-45eb-9c79-07addba53220 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:48.928650 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9acec317-dfd7-45eb-9c79-07addba53220 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:48.929293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9acec317-dfd7-45eb-9c79-07addba53220 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:49.035418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9acec317-dfd7-45eb-9c79-07addba53220 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:49.043632 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9acec317-dfd7-45eb-9c79-07addba53220 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1264 microversion: 2.1 time: 0.129553 Jul 20 17:50:49.044198 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 83/165] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:48 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1264 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:50.062878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c045ca12-9633-4dbd-86d9-076566b93829 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:50.063505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c045ca12-9633-4dbd-86d9-076566b93829 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:50.074803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c045ca12-9633-4dbd-86d9-076566b93829 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:50.076093 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c045ca12-9633-4dbd-86d9-076566b93829 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:50.077601 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c045ca12-9633-4dbd-86d9-076566b93829 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:50.078405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c045ca12-9633-4dbd-86d9-076566b93829 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:50.176061 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c045ca12-9633-4dbd-86d9-076566b93829 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:50.185217 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c045ca12-9633-4dbd-86d9-076566b93829 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1270 microversion: 2.1 time: 0.127430 Jul 20 17:50:50.185850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 83/166] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:50 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:51.203309 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0dc41454-ca2a-4eb3-abbd-f1e7d899361a tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:51.205646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0dc41454-ca2a-4eb3-abbd-f1e7d899361a tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:51.227340 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0dc41454-ca2a-4eb3-abbd-f1e7d899361a tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:51.228046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0dc41454-ca2a-4eb3-abbd-f1e7d899361a tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:51.234388 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0dc41454-ca2a-4eb3-abbd-f1e7d899361a tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:51.235031 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0dc41454-ca2a-4eb3-abbd-f1e7d899361a tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:51.316029 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0dc41454-ca2a-4eb3-abbd-f1e7d899361a tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:51.325034 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0dc41454-ca2a-4eb3-abbd-f1e7d899361a tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1270 microversion: 2.1 time: 0.126672 Jul 20 17:50:51.325882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 84/167] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:51 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1270 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:52.342579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b96dac97-c251-4283-8b54-ac5c12c9b8c8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:52.343289 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b96dac97-c251-4283-8b54-ac5c12c9b8c8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:52.356747 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b96dac97-c251-4283-8b54-ac5c12c9b8c8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:52.372295 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b96dac97-c251-4283-8b54-ac5c12c9b8c8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:52.375547 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b96dac97-c251-4283-8b54-ac5c12c9b8c8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:52.376399 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b96dac97-c251-4283-8b54-ac5c12c9b8c8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:52.973113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-18328378-8080-474e-8b01-96f417b53495 req-5e8a6499-c556-46cc-96ab-ae12515aa938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c3b7af6-1d5c-43f4-8521-384aecd7c5ec", "tag": "1a405173-c86c-4640-a62a-f018e073c704"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:50:53.030886 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b96dac97-c251-4283-8b54-ac5c12c9b8c8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:53.033082 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-18328378-8080-474e-8b01-96f417b53495 req-5e8a6499-c556-46cc-96ab-ae12515aa938 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:53.033535 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-18328378-8080-474e-8b01-96f417b53495 req-5e8a6499-c556-46cc-96ab-ae12515aa938 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:53.039045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b96dac97-c251-4283-8b54-ac5c12c9b8c8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.698076 Jul 20 17:50:53.039668 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 84/168] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:52 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:53.075267 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-18328378-8080-474e-8b01-96f417b53495 req-5e8a6499-c556-46cc-96ab-ae12515aa938 service nova] Creating event network-changed:1a405173-c86c-4640-a62a-f018e073c704 for instance 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec on hv-cinder-84984 Jul 20 17:50:53.089457 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-18328378-8080-474e-8b01-96f417b53495 req-5e8a6499-c556-46cc-96ab-ae12515aa938 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126369 Jul 20 17:50:53.105569 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 85/169] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:50:54.060586 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fa9f90be-21f5-47ce-99bd-d0e28eba774d tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:54.060586 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fa9f90be-21f5-47ce-99bd-d0e28eba774d tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:54.065421 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fa9f90be-21f5-47ce-99bd-d0e28eba774d tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:54.065875 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fa9f90be-21f5-47ce-99bd-d0e28eba774d tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:54.066742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fa9f90be-21f5-47ce-99bd-d0e28eba774d tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:54.067183 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fa9f90be-21f5-47ce-99bd-d0e28eba774d tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:54.230211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fa9f90be-21f5-47ce-99bd-d0e28eba774d tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:54.241720 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fa9f90be-21f5-47ce-99bd-d0e28eba774d tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.188598 Jul 20 17:50:54.242960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 85/170] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:54 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:55.260672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0d5e5648-bc64-4887-b51e-e25db22774cf tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:55.261313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0d5e5648-bc64-4887-b51e-e25db22774cf tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:55.271130 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0d5e5648-bc64-4887-b51e-e25db22774cf tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:55.271578 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0d5e5648-bc64-4887-b51e-e25db22774cf tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:55.272342 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0d5e5648-bc64-4887-b51e-e25db22774cf tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:55.272792 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0d5e5648-bc64-4887-b51e-e25db22774cf tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:55.435910 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0d5e5648-bc64-4887-b51e-e25db22774cf tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:55.444191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0d5e5648-bc64-4887-b51e-e25db22774cf tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.188236 Jul 20 17:50:55.447064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 86/171] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:55 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:56.460811 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ff5e0822-e549-493d-ab78-9d6acedd7f4e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:56.461420 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ff5e0822-e549-493d-ab78-9d6acedd7f4e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:56.468554 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:56.468669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff5e0822-e549-493d-ab78-9d6acedd7f4e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:56.469065 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff5e0822-e549-493d-ab78-9d6acedd7f4e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:56.469807 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff5e0822-e549-493d-ab78-9d6acedd7f4e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:56.470230 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff5e0822-e549-493d-ab78-9d6acedd7f4e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:56.656886 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ff5e0822-e549-493d-ab78-9d6acedd7f4e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:56.664655 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ff5e0822-e549-493d-ab78-9d6acedd7f4e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.207740 Jul 20 17:50:56.665419 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 86/172] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:56 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:57.681164 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5dbdc165-a7c2-44dd-ae1d-add71fa07207 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:57.681812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5dbdc165-a7c2-44dd-ae1d-add71fa07207 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:57.685148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:57.688817 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5dbdc165-a7c2-44dd-ae1d-add71fa07207 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:57.689267 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5dbdc165-a7c2-44dd-ae1d-add71fa07207 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:57.690032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5dbdc165-a7c2-44dd-ae1d-add71fa07207 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:57.691950 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5dbdc165-a7c2-44dd-ae1d-add71fa07207 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:57.847304 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5dbdc165-a7c2-44dd-ae1d-add71fa07207 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:57.856150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5dbdc165-a7c2-44dd-ae1d-add71fa07207 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.178789 Jul 20 17:50:57.856990 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 87/173] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:57 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:50:58.872953 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-57a89aae-ec35-433d-bb5f-c9ba5b81e317 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:50:58.878892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-57a89aae-ec35-433d-bb5f-c9ba5b81e317 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:50:58.878892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=8 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:58.897218 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-57a89aae-ec35-433d-bb5f-c9ba5b81e317 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:58.897931 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-57a89aae-ec35-433d-bb5f-c9ba5b81e317 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:58.898861 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-57a89aae-ec35-433d-bb5f-c9ba5b81e317 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:50:58.899446 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-57a89aae-ec35-433d-bb5f-c9ba5b81e317 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:50:59.095696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-57a89aae-ec35-433d-bb5f-c9ba5b81e317 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:50:59.111133 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-57a89aae-ec35-433d-bb5f-c9ba5b81e317 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.241861 Jul 20 17:50:59.111830 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 87/174] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:50:58 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:00.127485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f9f17bda-c8b1-46f1-b77d-df2fbc7eb268 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:00.129553 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f9f17bda-c8b1-46f1-b77d-df2fbc7eb268 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:00.146565 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f9f17bda-c8b1-46f1-b77d-df2fbc7eb268 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:00.146565 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f9f17bda-c8b1-46f1-b77d-df2fbc7eb268 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:00.146565 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f9f17bda-c8b1-46f1-b77d-df2fbc7eb268 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:00.146565 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f9f17bda-c8b1-46f1-b77d-df2fbc7eb268 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:00.299338 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f9f17bda-c8b1-46f1-b77d-df2fbc7eb268 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:00.310049 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f9f17bda-c8b1-46f1-b77d-df2fbc7eb268 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.186388 Jul 20 17:51:00.324018 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 88/175] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:00 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:01.327895 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0050a1f7-a6fe-439f-bd69-c8b2e1d77419 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:01.329143 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0050a1f7-a6fe-439f-bd69-c8b2e1d77419 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:01.336366 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0050a1f7-a6fe-439f-bd69-c8b2e1d77419 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:01.337178 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0050a1f7-a6fe-439f-bd69-c8b2e1d77419 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:01.338199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0050a1f7-a6fe-439f-bd69-c8b2e1d77419 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:01.339179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0050a1f7-a6fe-439f-bd69-c8b2e1d77419 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:01.493538 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0050a1f7-a6fe-439f-bd69-c8b2e1d77419 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:01.501187 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0050a1f7-a6fe-439f-bd69-c8b2e1d77419 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.177912 Jul 20 17:51:01.501759 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 88/176] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:01 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:02.078310 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1501248758", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:02.135575 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] validate_networks() for [('2628e491-f238-47ac-a0ee-cb782ad8236f', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:51:02.518072 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-21e7d63d-c18a-49b2-bb95-399ff6bfb94f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:02.519568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-21e7d63d-c18a-49b2-bb95-399ff6bfb94f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:02.530925 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-21e7d63d-c18a-49b2-bb95-399ff6bfb94f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:02.530925 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-21e7d63d-c18a-49b2-bb95-399ff6bfb94f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:02.530925 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-21e7d63d-c18a-49b2-bb95-399ff6bfb94f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:02.530925 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-21e7d63d-c18a-49b2-bb95-399ff6bfb94f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:02.586907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:51:02.588550 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:51:02.589581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:51:02.591636 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:51:02.592866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:51:02.606527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:02.607867 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:02.610193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:02.610642 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:02.638880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Getting quotas for project bde6b55e64864d188ee5fafc4b9edc4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:51:02.644458 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Getting quotas for user 8daac4acc2fb4d47a7549ef710a70fca and project bde6b55e64864d188ee5fafc4b9edc4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:51:02.657384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:51:02.659816 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:51:02.683336 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-21e7d63d-c18a-49b2-bb95-399ff6bfb94f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:02.692673 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-21e7d63d-c18a-49b2-bb95-399ff6bfb94f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.178379 Jul 20 17:51:02.693380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 89/177] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:02 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:02.945267 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9c70c9f5-fd5c-4cef-8db9-79c79532b800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.009892 Jul 20 17:51:02.946496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 89/178] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:51:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 17:51:02.956031 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0abdeb0c-b6af-4e93-b0d6-f52d8687c5ac tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:02.956805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0abdeb0c-b6af-4e93-b0d6-f52d8687c5ac tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:03.022346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0abdeb0c-b6af-4e93-b0d6-f52d8687c5ac tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:03.031222 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0abdeb0c-b6af-4e93-b0d6-f52d8687c5ac tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1222 microversion: 2.1 time: 0.078931 Jul 20 17:51:03.032096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 90/179] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:02 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:03.096951 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1481609156", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:03.187245 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] validate_networks() for [('2628e491-f238-47ac-a0ee-cb782ad8236f', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:51:03.575154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:51:03.575569 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:51:03.576063 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:51:03.577004 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:51:03.577424 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:51:03.591623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:03.592384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:03.593471 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:03.594002 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:03.612123 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Getting quotas for project bde6b55e64864d188ee5fafc4b9edc4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:51:03.616044 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Getting quotas for user 8daac4acc2fb4d47a7549ef710a70fca and project bde6b55e64864d188ee5fafc4b9edc4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:51:03.627507 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:51:03.629726 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:51:03.710210 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-07037a10-90c1-476a-a966-d0fafc2ac0e3 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:03.710824 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-07037a10-90c1-476a-a966-d0fafc2ac0e3 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:03.717691 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-07037a10-90c1-476a-a966-d0fafc2ac0e3 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:03.718137 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-07037a10-90c1-476a-a966-d0fafc2ac0e3 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:03.718988 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-07037a10-90c1-476a-a966-d0fafc2ac0e3 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:03.719433 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-07037a10-90c1-476a-a966-d0fafc2ac0e3 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:03.773672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5eff9ff6-84cd-4cd9-8fd3-6316bbf5fb4f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.683283 Jul 20 17:51:03.779698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 90/180] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:51:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:51:03.789047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e0126439-dc29-49ad-b5ff-52522cec99c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:03.790058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e0126439-dc29-49ad-b5ff-52522cec99c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:03.871346 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e0126439-dc29-49ad-b5ff-52522cec99c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:03.878655 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e0126439-dc29-49ad-b5ff-52522cec99c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1222 microversion: 2.1 time: 0.097865 Jul 20 17:51:03.879515 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 91/181] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:03 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:03.903236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-07037a10-90c1-476a-a966-d0fafc2ac0e3 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:03.911857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-07037a10-90c1-476a-a966-d0fafc2ac0e3 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.205474 Jul 20 17:51:03.912517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 91/182] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:03 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:04.125173 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-8e46f9ca-a792-4afe-8cc0-c344af16e70f req-3bfd3e31-30b6-46cf-966d-af6fcdc3e1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c3b7af6-1d5c-43f4-8521-384aecd7c5ec", "name": "network-vif-plugged", "status": "completed", "tag": "1a405173-c86c-4640-a62a-f018e073c704"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:04.133778 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8e46f9ca-a792-4afe-8cc0-c344af16e70f req-3bfd3e31-30b6-46cf-966d-af6fcdc3e1d1 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:04.134219 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8e46f9ca-a792-4afe-8cc0-c344af16e70f req-3bfd3e31-30b6-46cf-966d-af6fcdc3e1d1 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:04.146195 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-8e46f9ca-a792-4afe-8cc0-c344af16e70f req-3bfd3e31-30b6-46cf-966d-af6fcdc3e1d1 service nova] Creating event network-vif-plugged:1a405173-c86c-4640-a62a-f018e073c704 for instance 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec on hv-cinder-84984 Jul 20 17:51:04.152202 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-8e46f9ca-a792-4afe-8cc0-c344af16e70f req-3bfd3e31-30b6-46cf-966d-af6fcdc3e1d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031061 Jul 20 17:51:04.153140 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 92/183] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:04.895237 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a3d2a751-871c-4358-a414-e12b7f5b0d16 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:04.895863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a3d2a751-871c-4358-a414-e12b7f5b0d16 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:04.930856 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8ed3c54d-3369-41a3-9604-8a60216e27d8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:04.931634 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8ed3c54d-3369-41a3-9604-8a60216e27d8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:04.941868 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8ed3c54d-3369-41a3-9604-8a60216e27d8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:04.942395 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8ed3c54d-3369-41a3-9604-8a60216e27d8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:04.943288 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8ed3c54d-3369-41a3-9604-8a60216e27d8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:04.943778 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8ed3c54d-3369-41a3-9604-8a60216e27d8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:04.994678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a3d2a751-871c-4358-a414-e12b7f5b0d16 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:05.013856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a3d2a751-871c-4358-a414-e12b7f5b0d16 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1222 microversion: 2.1 time: 0.122401 Jul 20 17:51:05.016010 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 92/184] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:04 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:05.280751 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8ed3c54d-3369-41a3-9604-8a60216e27d8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:05.296786 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8ed3c54d-3369-41a3-9604-8a60216e27d8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1312 microversion: 2.1 time: 0.370308 Jul 20 17:51:05.297454 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 93/185] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:04 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:06.034224 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e4349d50-04aa-4058-a0de-3b829cb5a486 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:06.034835 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e4349d50-04aa-4058-a0de-3b829cb5a486 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:06.043083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e4349d50-04aa-4058-a0de-3b829cb5a486 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:06.043603 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e4349d50-04aa-4058-a0de-3b829cb5a486 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:06.044450 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e4349d50-04aa-4058-a0de-3b829cb5a486 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:06.044960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e4349d50-04aa-4058-a0de-3b829cb5a486 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:06.128155 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e4349d50-04aa-4058-a0de-3b829cb5a486 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:06.136971 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e4349d50-04aa-4058-a0de-3b829cb5a486 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1218 microversion: 2.1 time: 0.108757 Jul 20 17:51:06.138198 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 93/186] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:06 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:06.315526 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-86fa35a4-d744-4024-b240-bbe4f43bf84f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:06.316879 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-86fa35a4-d744-4024-b240-bbe4f43bf84f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:06.323843 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-86fa35a4-d744-4024-b240-bbe4f43bf84f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:06.324552 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-86fa35a4-d744-4024-b240-bbe4f43bf84f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:06.325544 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-86fa35a4-d744-4024-b240-bbe4f43bf84f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:06.326209 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-86fa35a4-d744-4024-b240-bbe4f43bf84f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:06.517323 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-86fa35a4-d744-4024-b240-bbe4f43bf84f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:06.524824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-86fa35a4-d744-4024-b240-bbe4f43bf84f tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1462 microversion: 2.1 time: 0.214692 Jul 20 17:51:06.535036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 94/187] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:06 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1462 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:06.566119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-39b9fa36-c851-4636-8cc5-5657c606bf5c tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:06.566617 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-39b9fa36-c851-4636-8cc5-5657c606bf5c tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:06.572829 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-39b9fa36-c851-4636-8cc5-5657c606bf5c tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:06.573275 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-39b9fa36-c851-4636-8cc5-5657c606bf5c tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:06.574027 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-39b9fa36-c851-4636-8cc5-5657c606bf5c tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:06.574456 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-39b9fa36-c851-4636-8cc5-5657c606bf5c tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:06.598727 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-39b9fa36-c851-4636-8cc5-5657c606bf5c tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:51:06.828548 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:07.122696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-39b9fa36-c851-4636-8cc5-5657c606bf5c tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 204 len: 0 microversion: 2.1 time: 0.560276 Jul 20 17:51:07.123869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 94/188] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:51:06 2022] DELETE /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:51:07.135428 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aed0c56e-0cd4-4a54-83c4-205d0ec2bf68 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:07.136053 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-aed0c56e-0cd4-4a54-83c4-205d0ec2bf68 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:07.138400 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:07.145849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aed0c56e-0cd4-4a54-83c4-205d0ec2bf68 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:07.146320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aed0c56e-0cd4-4a54-83c4-205d0ec2bf68 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:07.147087 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aed0c56e-0cd4-4a54-83c4-205d0ec2bf68 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:07.156963 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b36da3cc-72e5-4f86-a569-c49176e60058 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:07.163007 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aed0c56e-0cd4-4a54-83c4-205d0ec2bf68 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:07.175419 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b36da3cc-72e5-4f86-a569-c49176e60058 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:07.179050 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:07.185092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:07.190597 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b36da3cc-72e5-4f86-a569-c49176e60058 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:07.191307 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b36da3cc-72e5-4f86-a569-c49176e60058 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:07.195318 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b36da3cc-72e5-4f86-a569-c49176e60058 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:07.202936 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b36da3cc-72e5-4f86-a569-c49176e60058 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:07.304159 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b36da3cc-72e5-4f86-a569-c49176e60058 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:07.312993 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b36da3cc-72e5-4f86-a569-c49176e60058 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1274 microversion: 2.1 time: 0.162372 Jul 20 17:51:07.313586 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 95/189] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:07 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:07.377466 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aed0c56e-0cd4-4a54-83c4-205d0ec2bf68 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:07.386679 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-aed0c56e-0cd4-4a54-83c4-205d0ec2bf68 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1468 microversion: 2.1 time: 0.258555 Jul 20 17:51:07.395559 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 95/190] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:07 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1468 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:08.329769 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d4647bea-6cae-4221-a879-79927bb651e0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:08.330706 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d4647bea-6cae-4221-a879-79927bb651e0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:08.338617 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d4647bea-6cae-4221-a879-79927bb651e0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:08.339379 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d4647bea-6cae-4221-a879-79927bb651e0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:08.340521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d4647bea-6cae-4221-a879-79927bb651e0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:08.341398 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d4647bea-6cae-4221-a879-79927bb651e0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:08.409825 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e08cd15d-71d1-4b59-bf92-5df03abd9654 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:08.410570 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e08cd15d-71d1-4b59-bf92-5df03abd9654 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:08.411612 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d4647bea-6cae-4221-a879-79927bb651e0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:08.418284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e08cd15d-71d1-4b59-bf92-5df03abd9654 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:08.418807 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e08cd15d-71d1-4b59-bf92-5df03abd9654 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:08.419306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d4647bea-6cae-4221-a879-79927bb651e0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1274 microversion: 2.1 time: 0.093449 Jul 20 17:51:08.419525 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e08cd15d-71d1-4b59-bf92-5df03abd9654 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:08.421732 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 96/191] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:08 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:08.426533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e08cd15d-71d1-4b59-bf92-5df03abd9654 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:08.774669 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e08cd15d-71d1-4b59-bf92-5df03abd9654 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:08.783247 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e08cd15d-71d1-4b59-bf92-5df03abd9654 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1468 microversion: 2.1 time: 0.377351 Jul 20 17:51:08.784078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 96/192] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:08 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:09.441759 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c2f8d522-c4b5-4534-acc3-63efee436f5d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:09.442361 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c2f8d522-c4b5-4534-acc3-63efee436f5d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:09.449085 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2f8d522-c4b5-4534-acc3-63efee436f5d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:09.449529 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2f8d522-c4b5-4534-acc3-63efee436f5d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:09.452613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2f8d522-c4b5-4534-acc3-63efee436f5d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:09.452613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2f8d522-c4b5-4534-acc3-63efee436f5d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:09.515851 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c2f8d522-c4b5-4534-acc3-63efee436f5d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:09.525660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c2f8d522-c4b5-4534-acc3-63efee436f5d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1274 microversion: 2.1 time: 0.088043 Jul 20 17:51:09.526226 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 97/193] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:09 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:09.800392 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b8130ff4-bb5d-4d29-9cf1-db5b81e191f8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:09.801342 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b8130ff4-bb5d-4d29-9cf1-db5b81e191f8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:09.808641 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8130ff4-bb5d-4d29-9cf1-db5b81e191f8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:09.810447 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8130ff4-bb5d-4d29-9cf1-db5b81e191f8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:09.812846 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8130ff4-bb5d-4d29-9cf1-db5b81e191f8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:09.813285 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8130ff4-bb5d-4d29-9cf1-db5b81e191f8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:09.951885 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b8130ff4-bb5d-4d29-9cf1-db5b81e191f8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:09.960371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b8130ff4-bb5d-4d29-9cf1-db5b81e191f8 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1468 microversion: 2.1 time: 0.163970 Jul 20 17:51:09.960965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 97/194] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:09 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1468 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:10.542486 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0a9e3c1b-927d-4fac-9c00-712de6218168 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:10.543099 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0a9e3c1b-927d-4fac-9c00-712de6218168 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:10.550004 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c1b-927d-4fac-9c00-712de6218168 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:10.550525 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c1b-927d-4fac-9c00-712de6218168 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:10.551283 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c1b-927d-4fac-9c00-712de6218168 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:10.551715 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a9e3c1b-927d-4fac-9c00-712de6218168 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:10.614949 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0a9e3c1b-927d-4fac-9c00-712de6218168 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:10.622451 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0a9e3c1b-927d-4fac-9c00-712de6218168 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1282 microversion: 2.1 time: 0.083910 Jul 20 17:51:10.623031 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 98/195] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:10 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:10.982901 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f25bec57-7513-4256-b3f3-25c5b39e993e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:10.984143 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f25bec57-7513-4256-b3f3-25c5b39e993e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:11.028941 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-50cee9bc-04bc-4a77-b516-ec3c549f7ea2 req-a0e0bb3b-1e7a-4888-b435-3fe0a3c86304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae", "tag": "834d8ae3-1bcc-46f1-94a8-0bd4c43bc18c"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:11.049748 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f25bec57-7513-4256-b3f3-25c5b39e993e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:11.049748 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f25bec57-7513-4256-b3f3-25c5b39e993e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:11.049748 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f25bec57-7513-4256-b3f3-25c5b39e993e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:11.049748 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f25bec57-7513-4256-b3f3-25c5b39e993e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:11.054513 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-50cee9bc-04bc-4a77-b516-ec3c549f7ea2 req-a0e0bb3b-1e7a-4888-b435-3fe0a3c86304 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:11.055698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-50cee9bc-04bc-4a77-b516-ec3c549f7ea2 req-a0e0bb3b-1e7a-4888-b435-3fe0a3c86304 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:11.070379 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-50cee9bc-04bc-4a77-b516-ec3c549f7ea2 req-a0e0bb3b-1e7a-4888-b435-3fe0a3c86304 service nova] Creating event network-changed:834d8ae3-1bcc-46f1-94a8-0bd4c43bc18c for instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae on hv-cinder-84984 Jul 20 17:51:11.075794 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-50cee9bc-04bc-4a77-b516-ec3c549f7ea2 req-a0e0bb3b-1e7a-4888-b435-3fe0a3c86304 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052601 Jul 20 17:51:11.077171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 99/196] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:11.426411 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f25bec57-7513-4256-b3f3-25c5b39e993e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:11.435657 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f25bec57-7513-4256-b3f3-25c5b39e993e tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1468 microversion: 2.1 time: 0.460718 Jul 20 17:51:11.436978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 98/197] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:10 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1468 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:11.648415 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b2670f36-9c14-4d3f-837e-578770c6e881 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:11.649606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b2670f36-9c14-4d3f-837e-578770c6e881 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:11.656974 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2670f36-9c14-4d3f-837e-578770c6e881 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:11.658778 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2670f36-9c14-4d3f-837e-578770c6e881 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:11.660029 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2670f36-9c14-4d3f-837e-578770c6e881 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:11.660747 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2670f36-9c14-4d3f-837e-578770c6e881 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:11.753790 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b2670f36-9c14-4d3f-837e-578770c6e881 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:11.769687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b2670f36-9c14-4d3f-837e-578770c6e881 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1280 microversion: 2.1 time: 0.127201 Jul 20 17:51:11.780560 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 100/198] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:11 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:11.967868 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-5eb2b6b0-b141-44b4-b1cf-1026c38f26a7 req-aeeb7f07-a864-4f25-8161-d2b33931f979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c3b7af6-1d5c-43f4-8521-384aecd7c5ec", "name": "network-vif-deleted", "tag": "1a405173-c86c-4640-a62a-f018e073c704"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:11.985689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-5eb2b6b0-b141-44b4-b1cf-1026c38f26a7 req-aeeb7f07-a864-4f25-8161-d2b33931f979 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:11.986304 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-5eb2b6b0-b141-44b4-b1cf-1026c38f26a7 req-aeeb7f07-a864-4f25-8161-d2b33931f979 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:12.005975 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-5eb2b6b0-b141-44b4-b1cf-1026c38f26a7 req-aeeb7f07-a864-4f25-8161-d2b33931f979 service nova] Creating event network-vif-deleted:1a405173-c86c-4640-a62a-f018e073c704 for instance 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec on hv-cinder-84984 Jul 20 17:51:12.015750 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-5eb2b6b0-b141-44b4-b1cf-1026c38f26a7 req-aeeb7f07-a864-4f25-8161-d2b33931f979 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052909 Jul 20 17:51:12.017008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 99/199] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:12.453347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7c6cd2a4-7af3-42cc-9d5f-8b01af26f611 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:12.453959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7c6cd2a4-7af3-42cc-9d5f-8b01af26f611 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:12.459975 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7c6cd2a4-7af3-42cc-9d5f-8b01af26f611 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:12.460423 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7c6cd2a4-7af3-42cc-9d5f-8b01af26f611 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:12.461258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7c6cd2a4-7af3-42cc-9d5f-8b01af26f611 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:12.461692 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7c6cd2a4-7af3-42cc-9d5f-8b01af26f611 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:12.521640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7c6cd2a4-7af3-42cc-9d5f-8b01af26f611 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:12.529090 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7c6cd2a4-7af3-42cc-9d5f-8b01af26f611 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1297 microversion: 2.1 time: 0.079813 Jul 20 17:51:12.530160 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 101/200] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:12 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1297 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:12.790141 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a81e8305-d48d-4f79-a13d-2783fbc82eed tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:12.790752 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a81e8305-d48d-4f79-a13d-2783fbc82eed tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:12.797142 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a81e8305-d48d-4f79-a13d-2783fbc82eed tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:12.797584 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a81e8305-d48d-4f79-a13d-2783fbc82eed tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:12.798380 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a81e8305-d48d-4f79-a13d-2783fbc82eed tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:12.798808 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a81e8305-d48d-4f79-a13d-2783fbc82eed tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:12.931825 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a81e8305-d48d-4f79-a13d-2783fbc82eed tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:12.940508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a81e8305-d48d-4f79-a13d-2783fbc82eed tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.154679 Jul 20 17:51:12.941074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 100/201] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:12 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:13.546698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ced865fa-a7e4-4eb0-9ec9-90f80e37c8e5 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:13.547316 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ced865fa-a7e4-4eb0-9ec9-90f80e37c8e5 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:13.553809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ced865fa-a7e4-4eb0-9ec9-90f80e37c8e5 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:13.554258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ced865fa-a7e4-4eb0-9ec9-90f80e37c8e5 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:13.555049 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ced865fa-a7e4-4eb0-9ec9-90f80e37c8e5 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:13.555485 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ced865fa-a7e4-4eb0-9ec9-90f80e37c8e5 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:13.626877 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ced865fa-a7e4-4eb0-9ec9-90f80e37c8e5 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:13.634249 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ced865fa-a7e4-4eb0-9ec9-90f80e37c8e5 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1297 microversion: 2.1 time: 0.091924 Jul 20 17:51:13.634810 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 102/202] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:13 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:13.956466 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-307b2e3c-276b-467d-ad90-24be08f34143 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:13.957075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-307b2e3c-276b-467d-ad90-24be08f34143 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:13.958981 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=4 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:13.959696 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=14 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:13.964616 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-307b2e3c-276b-467d-ad90-24be08f34143 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:13.965062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-307b2e3c-276b-467d-ad90-24be08f34143 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:13.965822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-307b2e3c-276b-467d-ad90-24be08f34143 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:13.966260 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-307b2e3c-276b-467d-ad90-24be08f34143 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:14.099890 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-307b2e3c-276b-467d-ad90-24be08f34143 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:14.107377 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-307b2e3c-276b-467d-ad90-24be08f34143 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.154663 Jul 20 17:51:14.107942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 101/203] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:13 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:14.650685 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-41350240-2680-4bff-aeb2-85a3628fbe11 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:14.651284 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-41350240-2680-4bff-aeb2-85a3628fbe11 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:14.658012 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-41350240-2680-4bff-aeb2-85a3628fbe11 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:14.658496 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-41350240-2680-4bff-aeb2-85a3628fbe11 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:14.659240 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-41350240-2680-4bff-aeb2-85a3628fbe11 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:14.659672 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-41350240-2680-4bff-aeb2-85a3628fbe11 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:14.725996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-41350240-2680-4bff-aeb2-85a3628fbe11 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '694570bd24c74fd19e80bd822048067b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcdae79468045d0b5d773d8caf238e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:14.733939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-41350240-2680-4bff-aeb2-85a3628fbe11 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 200 len: 1297 microversion: 2.1 time: 0.086933 Jul 20 17:51:14.734602 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 103/204] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:14 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:15.123114 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bd8d81c1-75b5-47cb-810b-e3f805cdb523 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:15.124398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bd8d81c1-75b5-47cb-810b-e3f805cdb523 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:15.130730 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd8d81c1-75b5-47cb-810b-e3f805cdb523 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:15.131383 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd8d81c1-75b5-47cb-810b-e3f805cdb523 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:15.132156 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd8d81c1-75b5-47cb-810b-e3f805cdb523 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:15.132644 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd8d81c1-75b5-47cb-810b-e3f805cdb523 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:15.388332 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bd8d81c1-75b5-47cb-810b-e3f805cdb523 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:15.403030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bd8d81c1-75b5-47cb-810b-e3f805cdb523 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.283684 Jul 20 17:51:15.403814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 102/205] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:15 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:15.751799 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:15.753593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] [instance: 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:15.755869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=4 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:15.761551 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:15.762004 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:15.762773 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:15.763199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:15.776528 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] HTTP exception thrown: Instance 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec could not be found. Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Request method failure captured: Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec HTTP/1.1 Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EBzKgFx9KVUJ-NXYYvRpIECctuHnJfon-EER-W7S6trEpTxRH-2s10V2Wjvll8jTrwKeUFcLM2qKf6JvGQTbIriHJ9-J0YweUg7vcZdBso69oFqLMLYj8xfLr2v41UjPuXEwwehTOE8Jygxg0BJk9GelWbMo0FvU0cgWp4caBSKMik Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 0bcdae79468045d0b5d773d8caf238e6 Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-VolumesNegativeTest-903341406 Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:51:15.778321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0bcdae79468045d0b5d773d8caf238e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0bcdae79468045d0b5d773d8caf238e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0bcdae79468045d0b5d773d8caf238e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0bcdae79468045d0b5d773d8caf238e6"}]}] Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-VolumesNegativeTest-903341406 Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 0bcdae79468045d0b5d773d8caf238e6 Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-VolumesNegativeTest-903341406 Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-VolumesNegativeTest-903341406-project Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 694570bd24c74fd19e80bd822048067b Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-VolumesNegativeTest-903341406-project Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec could not be found. Jul 20 17:51:15.779526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '6c3b7af6-1d5c-43f4-8521-384aecd7c5ec'} Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec could not be found. Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:51:15.780202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec could not be found. Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec could not be found. Jul 20 17:51:15.781757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:51:15.782787 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] Returning 404 to user: Instance 6c3b7af6-1d5c-43f4-8521-384aecd7c5ec could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:51:15.782787 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-506c9ca1-0138-4de3-9c82-d0ff5346ef66 tempest-VolumesNegativeTest-903341406 tempest-VolumesNegativeTest-903341406-project] 10.222.0.42 "GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec" status: 404 len: 111 microversion: 2.1 time: 0.032425 Jul 20 17:51:15.782787 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 104/206] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:15 2022] GET /compute/v2.1/servers/6c3b7af6-1d5c-43f4-8521-384aecd7c5ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:51:15.837547 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-efb5a375-114b-48d5-9215-202988a39817 req-54ecb02e-9db2-443a-a586-be05a17bf4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9250617-ba07-4c3f-b362-f2ec35579329", "tag": "bae138e1-ebd0-4597-bcdb-3cf21bb88799"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:15.845884 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-efb5a375-114b-48d5-9215-202988a39817 req-54ecb02e-9db2-443a-a586-be05a17bf4dd service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:15.846347 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-efb5a375-114b-48d5-9215-202988a39817 req-54ecb02e-9db2-443a-a586-be05a17bf4dd service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:15.867098 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-efb5a375-114b-48d5-9215-202988a39817 req-54ecb02e-9db2-443a-a586-be05a17bf4dd service nova] Creating event network-changed:bae138e1-ebd0-4597-bcdb-3cf21bb88799 for instance c9250617-ba07-4c3f-b362-f2ec35579329 on hv-cinder-84984 Jul 20 17:51:15.872062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-efb5a375-114b-48d5-9215-202988a39817 req-54ecb02e-9db2-443a-a586-be05a17bf4dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038873 Jul 20 17:51:15.875450 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 103/207] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:16.013195 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fce0062c-6c81-4e90-aee3-bfb6968ba245 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:16.013848 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fce0062c-6c81-4e90-aee3-bfb6968ba245 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:16.020631 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fce0062c-6c81-4e90-aee3-bfb6968ba245 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:16.021079 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fce0062c-6c81-4e90-aee3-bfb6968ba245 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:16.021865 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fce0062c-6c81-4e90-aee3-bfb6968ba245 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:16.022275 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fce0062c-6c81-4e90-aee3-bfb6968ba245 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:16.046011 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fce0062c-6c81-4e90-aee3-bfb6968ba245 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/ips" status: 200 len: 151 microversion: 2.20 time: 0.036786 Jul 20 17:51:16.046585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 105/208] 10.222.0.42 () {60 vars in 1288 bytes} [Wed Jul 20 17:51:16 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:51:16.423527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fe364595-76c3-4e63-8e8a-89f24a9b0d4d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:16.424453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fe364595-76c3-4e63-8e8a-89f24a9b0d4d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:16.432922 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe364595-76c3-4e63-8e8a-89f24a9b0d4d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:16.433556 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe364595-76c3-4e63-8e8a-89f24a9b0d4d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:16.435198 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe364595-76c3-4e63-8e8a-89f24a9b0d4d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:16.437843 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe364595-76c3-4e63-8e8a-89f24a9b0d4d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:16.936800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fe364595-76c3-4e63-8e8a-89f24a9b0d4d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:16.945105 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fe364595-76c3-4e63-8e8a-89f24a9b0d4d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.528530 Jul 20 17:51:16.945686 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 104/209] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:16 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:17.962059 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1664f2e1-e3d4-49d8-8f61-4f026dacc279 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:17.962840 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1664f2e1-e3d4-49d8-8f61-4f026dacc279 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:17.970372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1664f2e1-e3d4-49d8-8f61-4f026dacc279 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:17.970825 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1664f2e1-e3d4-49d8-8f61-4f026dacc279 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:17.971591 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1664f2e1-e3d4-49d8-8f61-4f026dacc279 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:17.972027 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1664f2e1-e3d4-49d8-8f61-4f026dacc279 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:18.130430 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1664f2e1-e3d4-49d8-8f61-4f026dacc279 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:18.138177 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1664f2e1-e3d4-49d8-8f61-4f026dacc279 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.179895 Jul 20 17:51:18.139022 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 106/210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:17 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:18.727191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2bf191f6-5617-467a-a25d-990d9f2b5fc5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:18.727809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2bf191f6-5617-467a-a25d-990d9f2b5fc5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:18.734141 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bf191f6-5617-467a-a25d-990d9f2b5fc5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:18.734625 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bf191f6-5617-467a-a25d-990d9f2b5fc5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:18.735474 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bf191f6-5617-467a-a25d-990d9f2b5fc5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:18.735911 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bf191f6-5617-467a-a25d-990d9f2b5fc5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:18.760543 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-2bf191f6-5617-467a-a25d-990d9f2b5fc5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lazy-loading 'flavor' on Instance uuid 45b246c9-d9df-4348-9d5a-61c1170b1951 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:51:19.155824 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4b33576a-e023-45b5-a1b6-b8cbb3c6999d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:19.158075 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4b33576a-e023-45b5-a1b6-b8cbb3c6999d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:19.165656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4b33576a-e023-45b5-a1b6-b8cbb3c6999d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:19.166289 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4b33576a-e023-45b5-a1b6-b8cbb3c6999d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:19.167649 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4b33576a-e023-45b5-a1b6-b8cbb3c6999d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:19.168317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4b33576a-e023-45b5-a1b6-b8cbb3c6999d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:19.371046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4b33576a-e023-45b5-a1b6-b8cbb3c6999d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:19.388355 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4b33576a-e023-45b5-a1b6-b8cbb3c6999d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.235126 Jul 20 17:51:19.396678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 107/211] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:19 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:19.529012 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2bf191f6-5617-467a-a25d-990d9f2b5fc5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/action" status: 202 len: 0 microversion: 2.20 time: 0.806831 Jul 20 17:51:19.530815 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 105/212] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jul 20 17:51:18 2022] POST /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 17:51:19.539186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:19.539804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:19.550549 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:19.553734 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:19.554543 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:19.554988 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:19.784968 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:19.793942 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:19.796067 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:19.797461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-717fdf55-9a9d-4db0-bb63-a2581350da69 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.262303 Jul 20 17:51:19.798621 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 108/213] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:19 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:20.413553 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9af8a34d-d993-42e6-8fe7-2ccd36388f4a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:20.414426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9af8a34d-d993-42e6-8fe7-2ccd36388f4a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:20.422146 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9af8a34d-d993-42e6-8fe7-2ccd36388f4a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:20.423011 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9af8a34d-d993-42e6-8fe7-2ccd36388f4a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:20.423855 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9af8a34d-d993-42e6-8fe7-2ccd36388f4a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:20.424558 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9af8a34d-d993-42e6-8fe7-2ccd36388f4a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:20.595827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9af8a34d-d993-42e6-8fe7-2ccd36388f4a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:20.607611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9af8a34d-d993-42e6-8fe7-2ccd36388f4a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.197966 Jul 20 17:51:20.608849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 106/214] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:20 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:20.817716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:20.819001 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:20.835615 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:20.837215 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:20.840183 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:20.840776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:21.063487 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:21.077886 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:21.081573 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:21.090823 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e5e3ff5e-c7bf-4907-8eec-13ab10667aa8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.278358 Jul 20 17:51:21.091491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 109/215] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:20 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:21.237904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-c15cccc5-40c2-4556-9819-c4db7deedfed req-f2fe91ae-38af-47d0-b696-61dbe8b97da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae", "name": "network-vif-plugged", "status": "completed", "tag": "834d8ae3-1bcc-46f1-94a8-0bd4c43bc18c"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:21.248825 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c15cccc5-40c2-4556-9819-c4db7deedfed req-f2fe91ae-38af-47d0-b696-61dbe8b97da3 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:21.249509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c15cccc5-40c2-4556-9819-c4db7deedfed req-f2fe91ae-38af-47d0-b696-61dbe8b97da3 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:21.262948 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-c15cccc5-40c2-4556-9819-c4db7deedfed req-f2fe91ae-38af-47d0-b696-61dbe8b97da3 service nova] Creating event network-vif-plugged:834d8ae3-1bcc-46f1-94a8-0bd4c43bc18c for instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae on hv-cinder-84984 Jul 20 17:51:21.271539 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-c15cccc5-40c2-4556-9819-c4db7deedfed req-f2fe91ae-38af-47d0-b696-61dbe8b97da3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037966 Jul 20 17:51:21.272651 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 107/216] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:21.626474 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-608e1577-e3fe-490f-acf0-acd5f63aeead tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:21.627201 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-608e1577-e3fe-490f-acf0-acd5f63aeead tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:21.636417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-608e1577-e3fe-490f-acf0-acd5f63aeead tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:21.638346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-608e1577-e3fe-490f-acf0-acd5f63aeead tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:21.640282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-608e1577-e3fe-490f-acf0-acd5f63aeead tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:21.640825 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-608e1577-e3fe-490f-acf0-acd5f63aeead tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:21.845755 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-608e1577-e3fe-490f-acf0-acd5f63aeead tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:21.855502 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-608e1577-e3fe-490f-acf0-acd5f63aeead tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.234401 Jul 20 17:51:21.856313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 110/217] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:21 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:22.116220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:22.117639 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:22.124965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:22.125542 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:22.126437 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:22.127014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:22.310825 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:22.324734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:22.329300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:22.331246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2e738f1d-aa0a-4ba8-b88b-8b52a1ccb1c6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.223810 Jul 20 17:51:22.332371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 108/218] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:22 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:22.872466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ff009dd3-c41b-4c64-b1c4-aba4b766f5be tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:22.873113 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ff009dd3-c41b-4c64-b1c4-aba4b766f5be tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:22.881344 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff009dd3-c41b-4c64-b1c4-aba4b766f5be tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:22.881870 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff009dd3-c41b-4c64-b1c4-aba4b766f5be tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:22.882719 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff009dd3-c41b-4c64-b1c4-aba4b766f5be tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:22.883357 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff009dd3-c41b-4c64-b1c4-aba4b766f5be tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:23.151885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ff009dd3-c41b-4c64-b1c4-aba4b766f5be tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:23.161699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ff009dd3-c41b-4c64-b1c4-aba4b766f5be tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.292983 Jul 20 17:51:23.172050 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 111/219] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:22 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:23.287020 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-10cd8a75-e35c-49fc-8f13-9828a62310a7 req-37773aea-518b-4f19-823d-1cc48fa33b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9250617-ba07-4c3f-b362-f2ec35579329", "name": "network-vif-plugged", "status": "completed", "tag": "bae138e1-ebd0-4597-bcdb-3cf21bb88799"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:23.300195 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-10cd8a75-e35c-49fc-8f13-9828a62310a7 req-37773aea-518b-4f19-823d-1cc48fa33b65 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:23.304479 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-10cd8a75-e35c-49fc-8f13-9828a62310a7 req-37773aea-518b-4f19-823d-1cc48fa33b65 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:23.315090 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-10cd8a75-e35c-49fc-8f13-9828a62310a7 req-37773aea-518b-4f19-823d-1cc48fa33b65 service nova] Creating event network-vif-plugged:bae138e1-ebd0-4597-bcdb-3cf21bb88799 for instance c9250617-ba07-4c3f-b362-f2ec35579329 on hv-cinder-84984 Jul 20 17:51:23.319966 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-10cd8a75-e35c-49fc-8f13-9828a62310a7 req-37773aea-518b-4f19-823d-1cc48fa33b65 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036607 Jul 20 17:51:23.320619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 109/220] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:23.359981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:23.363730 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:23.374859 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:23.375535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:23.376320 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:23.376787 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:23.563661 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:23.572052 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:23.573694 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:23.574773 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-aac2d845-9e3f-49ba-8dd3-74e3bf499767 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.221244 Jul 20 17:51:23.575326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 112/221] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:23 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:23.745168 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-902f2a68-a383-4066-afb9-4e3e169102a2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:23.746077 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-902f2a68-a383-4066-afb9-4e3e169102a2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:23.774626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-902f2a68-a383-4066-afb9-4e3e169102a2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:23.782985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-902f2a68-a383-4066-afb9-4e3e169102a2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:23.782985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-902f2a68-a383-4066-afb9-4e3e169102a2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:23.782985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-902f2a68-a383-4066-afb9-4e3e169102a2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:23.814628 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-902f2a68-a383-4066-afb9-4e3e169102a2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/ips" status: 200 len: 149 microversion: 2.1 time: 0.096096 Jul 20 17:51:23.820809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 110/222] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 17:51:23 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/ips => generated 149 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:24.190405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9f285169-6a89-4a1c-8362-f835193d9741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:24.191069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9f285169-6a89-4a1c-8362-f835193d9741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:24.205202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9f285169-6a89-4a1c-8362-f835193d9741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:24.206123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9f285169-6a89-4a1c-8362-f835193d9741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:24.206913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9f285169-6a89-4a1c-8362-f835193d9741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:24.207354 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9f285169-6a89-4a1c-8362-f835193d9741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:24.211788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=100 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:24.485007 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9f285169-6a89-4a1c-8362-f835193d9741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:24.492370 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9f285169-6a89-4a1c-8362-f835193d9741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.312338 Jul 20 17:51:24.493060 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 113/223] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:24 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:24.676520 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:24.676520 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:24.676520 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:24.676520 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:24.677814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:24.677814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:24.827222 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:24.838833 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:24.841573 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:24.842816 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-94a2b9c9-fc1f-4d6f-9bce-91dfaaf606e9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.250000 Jul 20 17:51:24.844227 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 111/224] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:24 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:25.511397 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-07ba00b6-ba3b-43ef-8eef-c5a47ab890dd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:25.512808 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-07ba00b6-ba3b-43ef-8eef-c5a47ab890dd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:25.520374 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-07ba00b6-ba3b-43ef-8eef-c5a47ab890dd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:25.521004 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-07ba00b6-ba3b-43ef-8eef-c5a47ab890dd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:25.521887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-07ba00b6-ba3b-43ef-8eef-c5a47ab890dd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:25.522428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-07ba00b6-ba3b-43ef-8eef-c5a47ab890dd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:25.769095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-07ba00b6-ba3b-43ef-8eef-c5a47ab890dd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:25.777618 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-07ba00b6-ba3b-43ef-8eef-c5a47ab890dd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.271572 Jul 20 17:51:25.789090 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 114/225] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:25 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:25.872408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:25.872408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:25.879197 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:25.879653 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:25.880422 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:25.880898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:26.043618 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:26.046626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:26.054001 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:26.055690 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:26.056875 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-727f73b8-e22d-4f49-93f3-eca68d59d650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.199005 Jul 20 17:51:26.068690 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 112/226] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:25 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:26.793994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5d8a08a2-93d5-4b88-a774-5bb3b1f29008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:26.794608 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5d8a08a2-93d5-4b88-a774-5bb3b1f29008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:26.802202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5d8a08a2-93d5-4b88-a774-5bb3b1f29008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:26.802650 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5d8a08a2-93d5-4b88-a774-5bb3b1f29008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:26.803655 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5d8a08a2-93d5-4b88-a774-5bb3b1f29008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:26.804084 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5d8a08a2-93d5-4b88-a774-5bb3b1f29008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:27.077070 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:27.078556 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:27.082073 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5d8a08a2-93d5-4b88-a774-5bb3b1f29008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:27.086210 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:27.086817 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:27.087770 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:27.088821 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:27.091002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5d8a08a2-93d5-4b88-a774-5bb3b1f29008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.300937 Jul 20 17:51:27.101798 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 115/227] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:26 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:27.382492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:27.396300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:27.399257 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:27.401151 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3fce9537-d566-4a59-9898-6012adaaa2f9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.329438 Jul 20 17:51:27.402566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 113/228] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:27 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:51:28.109501 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e22cfac2-c064-4c5d-a043-a6e0df378008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:28.110173 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e22cfac2-c064-4c5d-a043-a6e0df378008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:28.126783 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e22cfac2-c064-4c5d-a043-a6e0df378008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:28.136890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e22cfac2-c064-4c5d-a043-a6e0df378008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:28.141519 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e22cfac2-c064-4c5d-a043-a6e0df378008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:28.141519 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e22cfac2-c064-4c5d-a043-a6e0df378008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:28.148874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4fd738c8-f8cc-4f6c-b392-371bfec99136 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4156de1-64f7-43f7-9d38-984b3c9508e4"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:28.150544 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4fd738c8-f8cc-4f6c-b392-371bfec99136 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:28.165842 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4fd738c8-f8cc-4f6c-b392-371bfec99136 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:28.166680 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4fd738c8-f8cc-4f6c-b392-371bfec99136 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:28.173512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4fd738c8-f8cc-4f6c-b392-371bfec99136 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:28.174438 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4fd738c8-f8cc-4f6c-b392-371bfec99136 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:28.464375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e22cfac2-c064-4c5d-a043-a6e0df378008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:28.483603 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e22cfac2-c064-4c5d-a043-a6e0df378008 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1322 microversion: 2.1 time: 0.379103 Jul 20 17:51:28.484605 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 116/229] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:28 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:28.489449 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:28.490514 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:28.499979 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:28.500501 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:28.501989 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:28.501989 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:28.736773 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:28.765630 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:28.767254 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:28.768511 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-56787616-bd33-42e2-b49b-bd06c88e1b44 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.282769 Jul 20 17:51:28.778038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 117/230] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:28 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:29.506592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-155ab282-2532-48d4-8506-2a703378f414 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:29.506592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-155ab282-2532-48d4-8506-2a703378f414 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:29.513026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-155ab282-2532-48d4-8506-2a703378f414 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:29.513677 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-155ab282-2532-48d4-8506-2a703378f414 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:29.515243 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-155ab282-2532-48d4-8506-2a703378f414 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:29.516057 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-155ab282-2532-48d4-8506-2a703378f414 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:29.593237 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4fd738c8-f8cc-4f6c-b392-371bfec99136 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.447789 Jul 20 17:51:29.593237 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 114/231] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:51:28 2022] POST /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments => generated 194 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:29.796975 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:29.798062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:29.813573 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:29.816701 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:29.821136 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:29.828904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:30.145293 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-155ab282-2532-48d4-8506-2a703378f414 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:30.154269 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:30.154901 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-155ab282-2532-48d4-8506-2a703378f414 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1516 microversion: 2.1 time: 0.657111 Jul 20 17:51:30.167822 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 118/232] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:29 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1516 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:30.175567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c9e8f4c5-7eb6-4615-929a-be6d00c5f457 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:30.176815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c9e8f4c5-7eb6-4615-929a-be6d00c5f457 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:30.187808 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c9e8f4c5-7eb6-4615-929a-be6d00c5f457 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:30.188492 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c9e8f4c5-7eb6-4615-929a-be6d00c5f457 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:30.189440 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c9e8f4c5-7eb6-4615-929a-be6d00c5f457 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:30.189946 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:30.190758 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c9e8f4c5-7eb6-4615-929a-be6d00c5f457 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:30.195201 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:30.199328 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7021cde0-5829-4d57-93f3-40697ab91a72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.405920 Jul 20 17:51:30.199971 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 115/233] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:29 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:51:30.231599 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-c9e8f4c5-7eb6-4615-929a-be6d00c5f457 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'flavor' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:51:30.639683 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c9e8f4c5-7eb6-4615-929a-be6d00c5f457 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329/action" status: 200 len: 32 microversion: 2.1 time: 0.470149 Jul 20 17:51:30.640216 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 119/234] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:51:30 2022] POST /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329/action => generated 32 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 17:51:30.649720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9d491ad1-202b-4e87-9c56-4aed3e9833c9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:30.650518 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9d491ad1-202b-4e87-9c56-4aed3e9833c9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:30.656593 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d491ad1-202b-4e87-9c56-4aed3e9833c9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:30.657043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d491ad1-202b-4e87-9c56-4aed3e9833c9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:30.657997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d491ad1-202b-4e87-9c56-4aed3e9833c9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:30.658437 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d491ad1-202b-4e87-9c56-4aed3e9833c9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:30.823575 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d491ad1-202b-4e87-9c56-4aed3e9833c9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:30.832030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9d491ad1-202b-4e87-9c56-4aed3e9833c9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.186588 Jul 20 17:51:30.832890 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 116/235] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:30 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:31.222400 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:31.223167 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:31.238076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:31.238555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:31.240020 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:31.240495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:31.351378 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-508466145", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "networks": [{"uuid": "76418757-051f-4c7d-9a32-4fe7635a563d"}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:31.426938 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] validate_networks() for [('76418757-051f-4c7d-9a32-4fe7635a563d', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:51:31.676672 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:31.703728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:31.705881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:31.707503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1a33ba56-5fe5-45d1-8976-1e8a4f701536 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.490978 Jul 20 17:51:31.708553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 120/236] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:31 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:31.850984 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bf2a7f86-81a4-44c8-9203-3c68d7688cd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:31.851607 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-bf2a7f86-81a4-44c8-9203-3c68d7688cd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:31.859875 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bf2a7f86-81a4-44c8-9203-3c68d7688cd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:31.860331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bf2a7f86-81a4-44c8-9203-3c68d7688cd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:31.861145 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bf2a7f86-81a4-44c8-9203-3c68d7688cd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:31.861701 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bf2a7f86-81a4-44c8-9203-3c68d7688cd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:32.227850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-bf2a7f86-81a4-44c8-9203-3c68d7688cd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:32.235896 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-bf2a7f86-81a4-44c8-9203-3c68d7688cd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.390506 Jul 20 17:51:32.240588 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 121/237] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:31 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:32.319117 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:51:32.319658 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:51:32.320116 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:51:32.320541 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:51:32.323627 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:51:32.330905 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:32.331442 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:32.332335 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:32.332836 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:32.353264 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Getting quotas for project 10e93d9f177d4ed5bba338ba68547bf7. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:51:32.358510 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Getting quotas for user 2bc0d03b364946a5b8af3db4e9fd4780 and project 10e93d9f177d4ed5bba338ba68547bf7. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:51:32.372602 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:51:32.375736 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:51:32.546670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b8d5bf2e-ec84-41d3-af4b-bb8c5ce84d31 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.208167 Jul 20 17:51:32.547258 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 117/238] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 17:51:32.557685 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eba680e7-abb3-4267-8947-a3dda8e7bd23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:32.558561 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-eba680e7-abb3-4267-8947-a3dda8e7bd23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:32.617440 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-eba680e7-abb3-4267-8947-a3dda8e7bd23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:32.626786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-eba680e7-abb3-4267-8947-a3dda8e7bd23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1218 microversion: 2.1 time: 0.073237 Jul 20 17:51:32.628492 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 122/239] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:32 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:32.730645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:32.736048 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:32.746350 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:32.746909 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:32.747931 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:32.749015 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:33.066899 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:33.081079 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:33.083395 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:33.088637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-da056a77-6fe7-4ec7-bf20-5c7536a806e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.360167 Jul 20 17:51:33.088637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 118/240] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:32 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:33.257373 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-56db84ad-bef6-42d3-8d2b-857e90268348 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:33.257982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-56db84ad-bef6-42d3-8d2b-857e90268348 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:33.264972 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56db84ad-bef6-42d3-8d2b-857e90268348 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:33.265424 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56db84ad-bef6-42d3-8d2b-857e90268348 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:33.266199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56db84ad-bef6-42d3-8d2b-857e90268348 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:33.266641 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56db84ad-bef6-42d3-8d2b-857e90268348 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:33.474375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-56db84ad-bef6-42d3-8d2b-857e90268348 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:33.485257 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-56db84ad-bef6-42d3-8d2b-857e90268348 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.231801 Jul 20 17:51:33.486249 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 123/241] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:33 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:33.643587 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-740b9447-0291-453e-bc6e-8f6277d1c0a6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:33.644193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-740b9447-0291-453e-bc6e-8f6277d1c0a6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:33.722600 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-740b9447-0291-453e-bc6e-8f6277d1c0a6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:33.737336 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-740b9447-0291-453e-bc6e-8f6277d1c0a6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1218 microversion: 2.1 time: 0.097466 Jul 20 17:51:33.739233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 119/242] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:33 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:34.104137 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:34.105080 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:34.117413 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:34.119399 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:34.120276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:34.122196 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:34.304155 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:34.313907 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:34.315718 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:34.317072 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8358e4fb-9d85-4adf-a390-53b9adc55765 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.217876 Jul 20 17:51:34.317823 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 124/243] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:34 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:34.507266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3767ee06-1562-40f2-b911-cade50e36a61 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:34.508116 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3767ee06-1562-40f2-b911-cade50e36a61 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:34.520096 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3767ee06-1562-40f2-b911-cade50e36a61 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:34.520568 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3767ee06-1562-40f2-b911-cade50e36a61 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:34.521331 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3767ee06-1562-40f2-b911-cade50e36a61 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:34.521760 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3767ee06-1562-40f2-b911-cade50e36a61 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:34.748711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3767ee06-1562-40f2-b911-cade50e36a61 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:34.755145 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3767ee06-1562-40f2-b911-cade50e36a61 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.255847 Jul 20 17:51:34.755810 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 120/244] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:34 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:34.756941 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ae58bd5f-58cf-46af-8441-2ef4744711e2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:34.757893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ae58bd5f-58cf-46af-8441-2ef4744711e2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:34.763886 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ae58bd5f-58cf-46af-8441-2ef4744711e2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:34.764340 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ae58bd5f-58cf-46af-8441-2ef4744711e2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:34.765179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ae58bd5f-58cf-46af-8441-2ef4744711e2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:34.765613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ae58bd5f-58cf-46af-8441-2ef4744711e2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:34.838430 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ae58bd5f-58cf-46af-8441-2ef4744711e2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:34.847030 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ae58bd5f-58cf-46af-8441-2ef4744711e2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1270 microversion: 2.1 time: 0.095074 Jul 20 17:51:34.847549 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 125/245] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:34 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:35.340876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:35.342889 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:35.375257 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:35.379057 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:35.380173 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:35.380859 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:35.630518 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:35.638962 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:35.640752 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:35.642298 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-50bfcf0c-cc83-4259-a9ee-5a4d055790a4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.308005 Jul 20 17:51:35.644964 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 121/246] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:35 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:35.773560 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7b36d6a0-e151-42f4-b639-4d3180a4af86 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:35.774232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7b36d6a0-e151-42f4-b639-4d3180a4af86 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:35.784604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7b36d6a0-e151-42f4-b639-4d3180a4af86 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:35.790023 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7b36d6a0-e151-42f4-b639-4d3180a4af86 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:35.791107 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7b36d6a0-e151-42f4-b639-4d3180a4af86 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:35.792970 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7b36d6a0-e151-42f4-b639-4d3180a4af86 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:35.863394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8bc74259-3bf3-4d65-bc18-0e5e54711f0a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:35.868041 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8bc74259-3bf3-4d65-bc18-0e5e54711f0a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:35.882302 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bc74259-3bf3-4d65-bc18-0e5e54711f0a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:35.882760 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bc74259-3bf3-4d65-bc18-0e5e54711f0a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:35.887383 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bc74259-3bf3-4d65-bc18-0e5e54711f0a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:35.887936 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bc74259-3bf3-4d65-bc18-0e5e54711f0a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:36.034341 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8bc74259-3bf3-4d65-bc18-0e5e54711f0a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:36.051080 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8bc74259-3bf3-4d65-bc18-0e5e54711f0a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1288 microversion: 2.1 time: 0.191642 Jul 20 17:51:36.051691 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 122/247] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:35 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1288 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:36.308740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7b36d6a0-e151-42f4-b639-4d3180a4af86 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:36.319820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7b36d6a0-e151-42f4-b639-4d3180a4af86 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.551198 Jul 20 17:51:36.320687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 126/248] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:35 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:36.666454 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:36.667699 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:36.676945 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:36.677719 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:36.678709 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:36.679228 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:37.072284 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-071a4cff-5487-4752-9931-2b66ef0635ba tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:37.073083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-071a4cff-5487-4752-9931-2b66ef0635ba tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:37.081331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-071a4cff-5487-4752-9931-2b66ef0635ba tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:37.081913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-071a4cff-5487-4752-9931-2b66ef0635ba tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:37.083032 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-071a4cff-5487-4752-9931-2b66ef0635ba tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:37.083869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-071a4cff-5487-4752-9931-2b66ef0635ba tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:37.234949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:37.245923 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:37.249213 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:37.251061 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-768a9b66-d8b1-4db9-8e4a-c0cadc0d6c78 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.588399 Jul 20 17:51:37.263221 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 123/249] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:36 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:51:37.339590 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-dd869f0a-0800-40ed-a653-d3689060a969 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:37.340699 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-dd869f0a-0800-40ed-a653-d3689060a969 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:37.361339 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dd869f0a-0800-40ed-a653-d3689060a969 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:37.362236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dd869f0a-0800-40ed-a653-d3689060a969 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:37.363246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dd869f0a-0800-40ed-a653-d3689060a969 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:37.363890 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dd869f0a-0800-40ed-a653-d3689060a969 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:37.583250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-071a4cff-5487-4752-9931-2b66ef0635ba tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:37.591288 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-071a4cff-5487-4752-9931-2b66ef0635ba tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.523953 Jul 20 17:51:37.597282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 127/250] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:37 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:37.641174 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-dd869f0a-0800-40ed-a653-d3689060a969 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:37.652797 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-dd869f0a-0800-40ed-a653-d3689060a969 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.318230 Jul 20 17:51:37.653933 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 124/251] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:37 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:38.283859 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:38.286718 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:38.302842 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:38.303287 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:38.304061 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:38.304525 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:38.454566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-631f7f28-4bd2-4c0f-b26b-1c1c99184be5 req-9bb2ad63-1beb-4bc4-9f95-0df9cafc8909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd17b0fa-8b69-4617-8534-d173f891cb78", "tag": "9da57d0b-3ca2-40d8-bd55-3eab7a018c3c"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:38.469544 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-631f7f28-4bd2-4c0f-b26b-1c1c99184be5 req-9bb2ad63-1beb-4bc4-9f95-0df9cafc8909 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:38.470188 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-631f7f28-4bd2-4c0f-b26b-1c1c99184be5 req-9bb2ad63-1beb-4bc4-9f95-0df9cafc8909 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:38.491844 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-631f7f28-4bd2-4c0f-b26b-1c1c99184be5 req-9bb2ad63-1beb-4bc4-9f95-0df9cafc8909 service nova] Creating event network-changed:9da57d0b-3ca2-40d8-bd55-3eab7a018c3c for instance bd17b0fa-8b69-4617-8534-d173f891cb78 on hv-cinder-84984 Jul 20 17:51:38.504332 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-631f7f28-4bd2-4c0f-b26b-1c1c99184be5 req-9bb2ad63-1beb-4bc4-9f95-0df9cafc8909 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053059 Jul 20 17:51:38.505185 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 125/252] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:51:38.615200 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-13039dfa-1df7-467c-b52e-aa5d06a2df95 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:38.616159 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-13039dfa-1df7-467c-b52e-aa5d06a2df95 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:38.628031 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-13039dfa-1df7-467c-b52e-aa5d06a2df95 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:38.628508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-13039dfa-1df7-467c-b52e-aa5d06a2df95 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:38.629485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-13039dfa-1df7-467c-b52e-aa5d06a2df95 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:38.629980 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-13039dfa-1df7-467c-b52e-aa5d06a2df95 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:38.638881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:38.638881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:38.642951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:38.644485 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:38.645697 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-02035595-615d-4729-82b4-a4550d02e983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.379586 Jul 20 17:51:38.646541 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 128/253] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:38 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:38.651240 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1440ee39-646a-4fc8-b3d1-5aad22f6c23e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: .version_select at 0x7f7d3da1d8b0>, body: {"keypair": {"name": "tempest-keypair-625890755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlRcphpdTW6Z4iCHYLGE9l/HLOUS4a7baEQiiMBYzY3uiNKMaqc8e0MW0NX1NfgZDUteXpZ0TOyZst8G/KvJPG1wGtT0c55MHAIqD75CZDfswIsThdIF0w+CCYspirhHA=="}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:38.678158 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-1440ee39-646a-4fc8-b3d1-5aad22f6c23e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for project 93918dc6b6f445d18a3ecb003524152d. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:51:38.682900 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-1440ee39-646a-4fc8-b3d1-5aad22f6c23e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for user 3077a7934f9c4407a70a8790b8da9cde and project 93918dc6b6f445d18a3ecb003524152d. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:51:38.775460 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1440ee39-646a-4fc8-b3d1-5aad22f6c23e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127807 Jul 20 17:51:38.776999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 129/254] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 17:51:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:38.783638 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ed0536ee-1035-42af-b034-bf7f92086625 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:38.786833 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ed0536ee-1035-42af-b034-bf7f92086625 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:38.806674 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ed0536ee-1035-42af-b034-bf7f92086625 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:38.809572 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ed0536ee-1035-42af-b034-bf7f92086625 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:38.816858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ed0536ee-1035-42af-b034-bf7f92086625 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:38.816858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ed0536ee-1035-42af-b034-bf7f92086625 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:39.056661 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-13039dfa-1df7-467c-b52e-aa5d06a2df95 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:39.069100 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-13039dfa-1df7-467c-b52e-aa5d06a2df95 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.454634 Jul 20 17:51:39.070335 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 126/255] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:38 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:39.268284 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ed0536ee-1035-42af-b034-bf7f92086625 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:39.282080 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ed0536ee-1035-42af-b034-bf7f92086625 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.503664 Jul 20 17:51:39.287086 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 130/256] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:38 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:39.663348 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:39.664046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:39.671100 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:39.671541 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:39.672672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:39.673357 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:39.898414 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:39.912321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:39.914428 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:39.916282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cd9dfa0c-eaee-426e-9108-d4b5df016a32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.256753 Jul 20 17:51:39.916938 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 127/257] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:39 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:40.086547 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-702775db-bda0-49cb-aaa2-5317afb7302c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:40.087191 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-702775db-bda0-49cb-aaa2-5317afb7302c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:40.094173 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-702775db-bda0-49cb-aaa2-5317afb7302c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:40.094627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-702775db-bda0-49cb-aaa2-5317afb7302c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:40.095394 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-702775db-bda0-49cb-aaa2-5317afb7302c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:40.095834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-702775db-bda0-49cb-aaa2-5317afb7302c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:40.254408 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-702775db-bda0-49cb-aaa2-5317afb7302c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:40.270110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-702775db-bda0-49cb-aaa2-5317afb7302c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.185984 Jul 20 17:51:40.275154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 131/258] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:40 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:40.303073 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5aa7cb7d-6073-4193-a54d-2d0f52c578b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:40.303765 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5aa7cb7d-6073-4193-a54d-2d0f52c578b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:40.306659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:40.310403 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5aa7cb7d-6073-4193-a54d-2d0f52c578b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:40.311464 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5aa7cb7d-6073-4193-a54d-2d0f52c578b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:40.312253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5aa7cb7d-6073-4193-a54d-2d0f52c578b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:40.312718 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5aa7cb7d-6073-4193-a54d-2d0f52c578b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:40.635937 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5aa7cb7d-6073-4193-a54d-2d0f52c578b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:40.652801 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5aa7cb7d-6073-4193-a54d-2d0f52c578b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.350846 Jul 20 17:51:40.653643 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 128/259] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:40 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:40.934532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:40.936672 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:40.939520 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:40.948660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:40.949189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:40.950015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:40.950458 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:41.219463 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:41.240460 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:41.250415 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:41.251626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9dbef33c-0082-4bf2-92a2-2b897b07eefc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.321036 Jul 20 17:51:41.259543 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 132/260] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:40 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:41.288477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bd85355f-5a95-4cbf-a7b9-7d484350bfbc tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:41.289893 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bd85355f-5a95-4cbf-a7b9-7d484350bfbc tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:41.305543 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd85355f-5a95-4cbf-a7b9-7d484350bfbc tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:41.308017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd85355f-5a95-4cbf-a7b9-7d484350bfbc tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:41.309721 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd85355f-5a95-4cbf-a7b9-7d484350bfbc tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:41.311608 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd85355f-5a95-4cbf-a7b9-7d484350bfbc tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:41.597215 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bd85355f-5a95-4cbf-a7b9-7d484350bfbc tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:41.605666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bd85355f-5a95-4cbf-a7b9-7d484350bfbc tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.321674 Jul 20 17:51:41.605890 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 129/261] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:41 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:41.675870 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-28bf4467-fcc9-4046-8bf8-ddbe3a7d230b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:41.677619 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-28bf4467-fcc9-4046-8bf8-ddbe3a7d230b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:41.691239 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-28bf4467-fcc9-4046-8bf8-ddbe3a7d230b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:41.691616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-28bf4467-fcc9-4046-8bf8-ddbe3a7d230b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:41.692491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-28bf4467-fcc9-4046-8bf8-ddbe3a7d230b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:41.692908 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-28bf4467-fcc9-4046-8bf8-ddbe3a7d230b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:41.956768 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-28bf4467-fcc9-4046-8bf8-ddbe3a7d230b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:41.968512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-28bf4467-fcc9-4046-8bf8-ddbe3a7d230b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.298304 Jul 20 17:51:41.970191 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 133/262] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:41 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:41.984695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-419387356", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e772fe92-4472-4af3-b6e9-3d6e16e3740d"}], "security_groups": [{"name": "tempest-securitygroup--1125644375"}], "key_name": "tempest-keypair-625890755", "user_data": "}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:42.153234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] validate_networks() for [('e772fe92-4472-4af3-b6e9-3d6e16e3740d', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:51:42.271366 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:42.272377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:42.278939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:42.287542 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:42.290018 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:42.291506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:42.340257 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:42.730655 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:42.741564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:42.743893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:42.746563 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7fa5b893-384f-4b9e-be54-a429dcc45870 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1745 microversion: 2.20 time: 0.480436 Jul 20 17:51:42.747720 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 134/263] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:42 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1745 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:42.764158 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-de2a560a-0088-459b-b162-884f80d6c7c0 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:42.764158 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-de2a560a-0088-459b-b162-884f80d6c7c0 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:42.767495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-de2a560a-0088-459b-b162-884f80d6c7c0 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:42.768264 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-de2a560a-0088-459b-b162-884f80d6c7c0 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:42.769365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-de2a560a-0088-459b-b162-884f80d6c7c0 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:42.769970 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-de2a560a-0088-459b-b162-884f80d6c7c0 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:43.086516 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:51:43.087193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:51:43.087882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:51:43.088668 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:51:43.089310 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:51:43.125664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:43.131413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:43.131413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:43.131413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:43.144802 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-de2a560a-0088-459b-b162-884f80d6c7c0 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:43.154173 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-de2a560a-0088-459b-b162-884f80d6c7c0 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.398848 Jul 20 17:51:43.156779 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 135/264] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:42 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:43.177187 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eb0e277a-7743-4edd-8d32-40a4f914cd2b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:43.180005 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-eb0e277a-7743-4edd-8d32-40a4f914cd2b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:43.193205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for project 93918dc6b6f445d18a3ecb003524152d. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:51:43.198590 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for user 3077a7934f9c4407a70a8790b8da9cde and project 93918dc6b6f445d18a3ecb003524152d. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:51:43.200928 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb0e277a-7743-4edd-8d32-40a4f914cd2b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:43.202327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb0e277a-7743-4edd-8d32-40a4f914cd2b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:43.204778 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb0e277a-7743-4edd-8d32-40a4f914cd2b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:43.205732 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb0e277a-7743-4edd-8d32-40a4f914cd2b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:43.213119 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:51:43.223630 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:51:43.407791 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-eb0e277a-7743-4edd-8d32-40a4f914cd2b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:43.416490 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-eb0e277a-7743-4edd-8d32-40a4f914cd2b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.245807 Jul 20 17:51:43.430584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 136/265] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:43 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:43.448759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f3d58cf7-9592-4963-81f1-62666c0bc0c7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.469407 Jul 20 17:51:43.455375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 130/266] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:51:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:51:43.463481 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-499a7072-f479-4db2-924f-45397cb3476a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:43.464101 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-499a7072-f479-4db2-924f-45397cb3476a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:43.546699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-499a7072-f479-4db2-924f-45397cb3476a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:43.554231 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-499a7072-f479-4db2-924f-45397cb3476a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1240 microversion: 2.1 time: 0.097888 Jul 20 17:51:43.555892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 137/267] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:43 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:43.772077 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:43.773237 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:43.781674 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:43.782274 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:43.783483 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:43.784611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:43.813347 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:43.954533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:43.963969 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:43.965641 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:43.967563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cc38d5e7-90cb-4943-85b4-453e942bdced tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1745 microversion: 2.20 time: 0.198907 Jul 20 17:51:43.968218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 131/268] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:43 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1745 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:44.172987 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6ae05fc7-2ce6-4728-aadc-2fb5fa2f3555 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:44.176566 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6ae05fc7-2ce6-4728-aadc-2fb5fa2f3555 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:44.188875 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ae05fc7-2ce6-4728-aadc-2fb5fa2f3555 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:44.189328 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ae05fc7-2ce6-4728-aadc-2fb5fa2f3555 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:44.190101 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ae05fc7-2ce6-4728-aadc-2fb5fa2f3555 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:44.190540 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ae05fc7-2ce6-4728-aadc-2fb5fa2f3555 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:44.379772 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6ae05fc7-2ce6-4728-aadc-2fb5fa2f3555 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:44.409082 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6ae05fc7-2ce6-4728-aadc-2fb5fa2f3555 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.237974 Jul 20 17:51:44.412075 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 138/269] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:44 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:44.441113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9fca1520-b963-4f39-9cae-43ffa7a3745d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:44.442250 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9fca1520-b963-4f39-9cae-43ffa7a3745d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:44.452193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9fca1520-b963-4f39-9cae-43ffa7a3745d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:44.454664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9fca1520-b963-4f39-9cae-43ffa7a3745d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:44.455486 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9fca1520-b963-4f39-9cae-43ffa7a3745d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:44.455926 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9fca1520-b963-4f39-9cae-43ffa7a3745d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:44.578068 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-da1f23e6-b46c-48ee-820d-560b2e370078 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:44.578068 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-da1f23e6-b46c-48ee-820d-560b2e370078 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:44.586396 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da1f23e6-b46c-48ee-820d-560b2e370078 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:44.589556 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da1f23e6-b46c-48ee-820d-560b2e370078 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:44.591276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da1f23e6-b46c-48ee-820d-560b2e370078 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:44.592396 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da1f23e6-b46c-48ee-820d-560b2e370078 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:44.695454 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-da1f23e6-b46c-48ee-820d-560b2e370078 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:44.703598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9fca1520-b963-4f39-9cae-43ffa7a3745d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:44.704461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-da1f23e6-b46c-48ee-820d-560b2e370078 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1244 microversion: 2.1 time: 0.135756 Jul 20 17:51:44.705251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 139/270] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:44 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1244 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:44.711598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9fca1520-b963-4f39-9cae-43ffa7a3745d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.281929 Jul 20 17:51:44.720313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 132/271] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:44 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:44.987373 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:44.988001 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:44.994475 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:44.995179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:44.996104 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:44.996789 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:45.138452 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:45.146434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:45.148096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:45.149292 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-35f20148-00a2-4d9d-8fdd-e5263829fc36 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1745 microversion: 2.20 time: 0.167501 Jul 20 17:51:45.149853 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 140/272] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:44 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:45.428205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b0d9aa3d-4c8d-4b74-88e3-1d7358875a9c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:45.429002 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b0d9aa3d-4c8d-4b74-88e3-1d7358875a9c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:45.435414 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b0d9aa3d-4c8d-4b74-88e3-1d7358875a9c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:45.436386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b0d9aa3d-4c8d-4b74-88e3-1d7358875a9c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:45.437171 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b0d9aa3d-4c8d-4b74-88e3-1d7358875a9c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:45.437722 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b0d9aa3d-4c8d-4b74-88e3-1d7358875a9c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:45.570030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b0d9aa3d-4c8d-4b74-88e3-1d7358875a9c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:45.577627 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b0d9aa3d-4c8d-4b74-88e3-1d7358875a9c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.153772 Jul 20 17:51:45.578326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 133/273] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:45 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:45.723557 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b82e26e5-8658-4618-86ac-215de005a52d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:45.732027 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b82e26e5-8658-4618-86ac-215de005a52d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:45.734146 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a65161dc-5ca8-4087-ade7-75de08b6521b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:45.734286 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a65161dc-5ca8-4087-ade7-75de08b6521b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:45.741827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a65161dc-5ca8-4087-ade7-75de08b6521b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:45.746530 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a65161dc-5ca8-4087-ade7-75de08b6521b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:45.746671 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b82e26e5-8658-4618-86ac-215de005a52d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:45.746671 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b82e26e5-8658-4618-86ac-215de005a52d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:45.746847 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a65161dc-5ca8-4087-ade7-75de08b6521b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:45.746847 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a65161dc-5ca8-4087-ade7-75de08b6521b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:45.747030 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b82e26e5-8658-4618-86ac-215de005a52d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:45.747030 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b82e26e5-8658-4618-86ac-215de005a52d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:45.883271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b82e26e5-8658-4618-86ac-215de005a52d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:45.894935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b82e26e5-8658-4618-86ac-215de005a52d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1244 microversion: 2.1 time: 0.175559 Jul 20 17:51:45.895514 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 141/274] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:45 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1244 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:45.963820 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a65161dc-5ca8-4087-ade7-75de08b6521b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:45.978782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a65161dc-5ca8-4087-ade7-75de08b6521b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.252953 Jul 20 17:51:45.980018 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 134/275] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:45 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:46.168577 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:46.170091 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:46.180728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:46.181500 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:46.182628 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:46.183382 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:46.354202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:46.362779 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:46.364353 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:46.365616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4fa37d8f-a5f8-4f32-b7da-d28f5df04115 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.202239 Jul 20 17:51:46.377345 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 142/276] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:46 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:46.599547 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e0cccd5a-61f3-4b5e-9e53-754eb882a261 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:46.613881 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e0cccd5a-61f3-4b5e-9e53-754eb882a261 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:46.630042 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e0cccd5a-61f3-4b5e-9e53-754eb882a261 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:46.632604 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e0cccd5a-61f3-4b5e-9e53-754eb882a261 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:46.633694 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e0cccd5a-61f3-4b5e-9e53-754eb882a261 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:46.635305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e0cccd5a-61f3-4b5e-9e53-754eb882a261 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:46.837117 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e0cccd5a-61f3-4b5e-9e53-754eb882a261 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:46.844601 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e0cccd5a-61f3-4b5e-9e53-754eb882a261 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.253752 Jul 20 17:51:46.854620 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 135/277] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:46 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:46.914996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6ce0facd-2148-4d8e-8d4d-60aed5369e21 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:46.915619 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6ce0facd-2148-4d8e-8d4d-60aed5369e21 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:46.925918 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ce0facd-2148-4d8e-8d4d-60aed5369e21 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:46.926376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ce0facd-2148-4d8e-8d4d-60aed5369e21 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:46.927203 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ce0facd-2148-4d8e-8d4d-60aed5369e21 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:46.927645 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ce0facd-2148-4d8e-8d4d-60aed5369e21 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:46.996233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-48f76928-ef57-4f05-99a8-333a69d79f92 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:46.997102 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-48f76928-ef57-4f05-99a8-333a69d79f92 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:47.003770 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48f76928-ef57-4f05-99a8-333a69d79f92 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:47.004213 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48f76928-ef57-4f05-99a8-333a69d79f92 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:47.004997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48f76928-ef57-4f05-99a8-333a69d79f92 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:47.009019 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48f76928-ef57-4f05-99a8-333a69d79f92 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:47.028426 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6ce0facd-2148-4d8e-8d4d-60aed5369e21 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:47.039252 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6ce0facd-2148-4d8e-8d4d-60aed5369e21 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1300 microversion: 2.1 time: 0.130606 Jul 20 17:51:47.043633 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 143/278] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:46 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:47.235179 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-48f76928-ef57-4f05-99a8-333a69d79f92 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:47.260396 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-48f76928-ef57-4f05-99a8-333a69d79f92 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.267917 Jul 20 17:51:47.268766 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 136/279] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:46 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:47.390174 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:47.391221 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:47.410704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:47.411202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:47.411986 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:47.412495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:47.661686 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:47.670857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:47.672279 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:47.673558 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-71fdc781-7401-4e9e-91ad-cf7cdd761460 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.289546 Jul 20 17:51:47.686444 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 144/280] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:47 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:47.862317 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-25c6e4a0-cb79-4df8-9dd6-a1a1fa78fbf2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:47.863110 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-25c6e4a0-cb79-4df8-9dd6-a1a1fa78fbf2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:47.876964 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-25c6e4a0-cb79-4df8-9dd6-a1a1fa78fbf2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:47.878112 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-25c6e4a0-cb79-4df8-9dd6-a1a1fa78fbf2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:47.879617 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-25c6e4a0-cb79-4df8-9dd6-a1a1fa78fbf2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:47.882564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-25c6e4a0-cb79-4df8-9dd6-a1a1fa78fbf2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:48.020785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-92204787-8af9-47c2-91c7-70e4798b2657 req-90b4ca37-f939-4e6b-a285-909419543d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b246c9-d9df-4348-9d5a-61c1170b1951", "name": "network-vif-plugged", "status": "completed", "tag": "c0861927-5eef-4dee-a02c-a3bed737a580"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:48.042871 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-92204787-8af9-47c2-91c7-70e4798b2657 req-90b4ca37-f939-4e6b-a285-909419543d49 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:48.061152 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-92204787-8af9-47c2-91c7-70e4798b2657 req-90b4ca37-f939-4e6b-a285-909419543d49 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:48.250241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-92204787-8af9-47c2-91c7-70e4798b2657 req-90b4ca37-f939-4e6b-a285-909419543d49 service nova] Creating event network-vif-plugged:c0861927-5eef-4dee-a02c-a3bed737a580 for instance 45b246c9-d9df-4348-9d5a-61c1170b1951 on hv-cinder-84984 Jul 20 17:51:48.250241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-92204787-8af9-47c2-91c7-70e4798b2657 req-90b4ca37-f939-4e6b-a285-909419543d49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116605 Jul 20 17:51:48.250241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 145/281] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:51:48.250241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c959b027-d214-4583-93b2-5082ed0c1ca2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:48.250241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c959b027-d214-4583-93b2-5082ed0c1ca2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:48.251062 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c959b027-d214-4583-93b2-5082ed0c1ca2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:48.251062 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c959b027-d214-4583-93b2-5082ed0c1ca2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:48.251062 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c959b027-d214-4583-93b2-5082ed0c1ca2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:48.251062 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c959b027-d214-4583-93b2-5082ed0c1ca2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:48.449190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c959b027-d214-4583-93b2-5082ed0c1ca2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:48.464063 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c959b027-d214-4583-93b2-5082ed0c1ca2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1298 microversion: 2.1 time: 0.326730 Jul 20 17:51:48.486477 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 146/282] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:48 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1298 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:48.494893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8b37fbe3-b523-4569-9647-8ad677910dcc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:48.499712 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8b37fbe3-b523-4569-9647-8ad677910dcc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:48.513431 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8b37fbe3-b523-4569-9647-8ad677910dcc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:48.514477 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8b37fbe3-b523-4569-9647-8ad677910dcc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:48.515273 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8b37fbe3-b523-4569-9647-8ad677910dcc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:48.515715 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8b37fbe3-b523-4569-9647-8ad677910dcc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:48.894860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-25c6e4a0-cb79-4df8-9dd6-a1a1fa78fbf2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:48.911467 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-25c6e4a0-cb79-4df8-9dd6-a1a1fa78fbf2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 1.044400 Jul 20 17:51:48.911467 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 137/283] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:47 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:48.924107 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:48.924744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:48.931377 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:48.931826 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:48.932753 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:48.933203 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:48.965912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8b37fbe3-b523-4569-9647-8ad677910dcc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:48.979739 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8b37fbe3-b523-4569-9647-8ad677910dcc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.497130 Jul 20 17:51:48.991788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 147/284] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:48 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:49.116801 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:49.125017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:49.126797 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:49.128190 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-83204ffa-0a92-4873-b1b0-77ba6ff3978a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.208063 Jul 20 17:51:49.129594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 138/285] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:48 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:49.485091 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-411dbb66-d289-448c-816d-8393c6eeec9d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:49.486548 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-411dbb66-d289-448c-816d-8393c6eeec9d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:49.512401 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-411dbb66-d289-448c-816d-8393c6eeec9d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:49.512893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-411dbb66-d289-448c-816d-8393c6eeec9d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:49.515991 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-411dbb66-d289-448c-816d-8393c6eeec9d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:49.516451 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-411dbb66-d289-448c-816d-8393c6eeec9d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:49.547607 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=100 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:49.926887 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c3860b9b-f72a-4beb-ba44-e4e597a9ad97 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:49.927496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c3860b9b-f72a-4beb-ba44-e4e597a9ad97 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:49.949998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3860b9b-f72a-4beb-ba44-e4e597a9ad97 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:49.953910 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3860b9b-f72a-4beb-ba44-e4e597a9ad97 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:49.959543 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3860b9b-f72a-4beb-ba44-e4e597a9ad97 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:49.977890 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3860b9b-f72a-4beb-ba44-e4e597a9ad97 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:49.983816 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-411dbb66-d289-448c-816d-8393c6eeec9d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:49.996741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-411dbb66-d289-448c-816d-8393c6eeec9d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.513764 Jul 20 17:51:50.031260 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 148/286] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:49 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:50.049452 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3eac777f-c2c5-4cae-a913-af15ee3ac7c4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:50.053436 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3eac777f-c2c5-4cae-a913-af15ee3ac7c4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:50.062499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3eac777f-c2c5-4cae-a913-af15ee3ac7c4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:50.064059 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3eac777f-c2c5-4cae-a913-af15ee3ac7c4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:50.064306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3eac777f-c2c5-4cae-a913-af15ee3ac7c4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:50.064985 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3eac777f-c2c5-4cae-a913-af15ee3ac7c4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:50.557157 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3860b9b-f72a-4beb-ba44-e4e597a9ad97 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:50.565358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c3860b9b-f72a-4beb-ba44-e4e597a9ad97 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.642272 Jul 20 17:51:50.570047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 139/287] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:49 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:50.583260 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:50.594038 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:50.612854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:50.614092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:50.615047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:50.617983 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:50.639186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3eac777f-c2c5-4cae-a913-af15ee3ac7c4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:50.655926 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3eac777f-c2c5-4cae-a913-af15ee3ac7c4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.622152 Jul 20 17:51:50.664458 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 149/288] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:50 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:50.679590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-4a4b0947-061e-4e31-af0b-f38f1d6b268e req-314506d7-c60c-4f53-a6c7-38a5727d7b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd17b0fa-8b69-4617-8534-d173f891cb78", "name": "network-vif-plugged", "status": "completed", "tag": "9da57d0b-3ca2-40d8-bd55-3eab7a018c3c"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:50.695147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-4a4b0947-061e-4e31-af0b-f38f1d6b268e req-314506d7-c60c-4f53-a6c7-38a5727d7b87 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:50.701508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-4a4b0947-061e-4e31-af0b-f38f1d6b268e req-314506d7-c60c-4f53-a6c7-38a5727d7b87 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:50.733994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-4a4b0947-061e-4e31-af0b-f38f1d6b268e req-314506d7-c60c-4f53-a6c7-38a5727d7b87 service nova] Creating event network-vif-plugged:9da57d0b-3ca2-40d8-bd55-3eab7a018c3c for instance bd17b0fa-8b69-4617-8534-d173f891cb78 on hv-cinder-84984 Jul 20 17:51:50.751436 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-4a4b0947-061e-4e31-af0b-f38f1d6b268e req-314506d7-c60c-4f53-a6c7-38a5727d7b87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085078 Jul 20 17:51:50.752057 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 150/289] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:51.028113 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cab1fd47-303e-4da4-8a00-561e7bff8503 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:51.029210 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cab1fd47-303e-4da4-8a00-561e7bff8503 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:51.042450 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cab1fd47-303e-4da4-8a00-561e7bff8503 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:51.043178 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cab1fd47-303e-4da4-8a00-561e7bff8503 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:51.044195 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cab1fd47-303e-4da4-8a00-561e7bff8503 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:51.044860 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cab1fd47-303e-4da4-8a00-561e7bff8503 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:51.392270 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:51.408744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:51.410908 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:51.412322 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-565f5992-84f1-4d8d-98d6-c749140200a1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.838837 Jul 20 17:51:51.426785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 140/290] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:50 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:51.586956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2c6489dc-23d3-4337-9a41-c6ddd0cd807e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:51.587802 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2c6489dc-23d3-4337-9a41-c6ddd0cd807e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:51.600035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c6489dc-23d3-4337-9a41-c6ddd0cd807e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:51.600769 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c6489dc-23d3-4337-9a41-c6ddd0cd807e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:51.602878 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c6489dc-23d3-4337-9a41-c6ddd0cd807e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:51.603550 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c6489dc-23d3-4337-9a41-c6ddd0cd807e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:51.648034 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cab1fd47-303e-4da4-8a00-561e7bff8503 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:51.660322 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cab1fd47-303e-4da4-8a00-561e7bff8503 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.636884 Jul 20 17:51:51.669936 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 151/291] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:51 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:51.684623 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7fdfa3a6-d178-495b-920f-ae910d23cb7e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:51.686010 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7fdfa3a6-d178-495b-920f-ae910d23cb7e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:51.694325 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fdfa3a6-d178-495b-920f-ae910d23cb7e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:51.695179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fdfa3a6-d178-495b-920f-ae910d23cb7e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:51.696176 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fdfa3a6-d178-495b-920f-ae910d23cb7e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:51.697155 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fdfa3a6-d178-495b-920f-ae910d23cb7e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:52.163438 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7fdfa3a6-d178-495b-920f-ae910d23cb7e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:52.171626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7fdfa3a6-d178-495b-920f-ae910d23cb7e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.494235 Jul 20 17:51:52.181215 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 152/292] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:51 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:52.196841 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2c6489dc-23d3-4337-9a41-c6ddd0cd807e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:52.212205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2c6489dc-23d3-4337-9a41-c6ddd0cd807e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.628880 Jul 20 17:51:52.213205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 141/293] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:51 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:52.434131 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:52.434745 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:52.444264 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:52.445700 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:52.446723 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:52.447323 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:52.612023 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:52.621914 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:52.623959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:52.625241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7ee768fa-d358-4cf0-95b1-9c2368a03f70 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.194964 Jul 20 17:51:52.626288 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 153/294] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:52 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:52.683052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d12eb0e4-8fb9-4c67-ba2b-c6712661dcc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:52.685265 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d12eb0e4-8fb9-4c67-ba2b-c6712661dcc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:52.690188 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-4d797ed8-b2fe-4c37-b422-572d3e2b7a26 req-ed044072-ccb8-48a7-aefc-c3febc0ea757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a959b594-9ce2-4fb1-b648-4016dfecb1b1", "tag": "ea69bd29-73fa-4c45-8d4a-013f8382d993"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:52.713023 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-4d797ed8-b2fe-4c37-b422-572d3e2b7a26 req-ed044072-ccb8-48a7-aefc-c3febc0ea757 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:52.713492 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-4d797ed8-b2fe-4c37-b422-572d3e2b7a26 req-ed044072-ccb8-48a7-aefc-c3febc0ea757 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:52.739368 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d12eb0e4-8fb9-4c67-ba2b-c6712661dcc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:52.740324 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d12eb0e4-8fb9-4c67-ba2b-c6712661dcc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:52.742497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d12eb0e4-8fb9-4c67-ba2b-c6712661dcc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:52.743393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d12eb0e4-8fb9-4c67-ba2b-c6712661dcc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:52.754949 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-4d797ed8-b2fe-4c37-b422-572d3e2b7a26 req-ed044072-ccb8-48a7-aefc-c3febc0ea757 service nova] Creating event network-changed:ea69bd29-73fa-4c45-8d4a-013f8382d993 for instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 on hv-cinder-84984 Jul 20 17:51:52.778570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-4d797ed8-b2fe-4c37-b422-572d3e2b7a26 req-ed044072-ccb8-48a7-aefc-c3febc0ea757 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093045 Jul 20 17:51:52.781413 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 154/295] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:53.049673 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d12eb0e4-8fb9-4c67-ba2b-c6712661dcc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:53.115872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d12eb0e4-8fb9-4c67-ba2b-c6712661dcc4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.442191 Jul 20 17:51:53.118234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 142/296] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:52 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:53.191099 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-58df517e-622f-424c-84d7-d480c0e24165 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:53.192094 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-58df517e-622f-424c-84d7-d480c0e24165 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:53.213532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-58df517e-622f-424c-84d7-d480c0e24165 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:53.213532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-58df517e-622f-424c-84d7-d480c0e24165 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:53.213532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-58df517e-622f-424c-84d7-d480c0e24165 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:53.213532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-58df517e-622f-424c-84d7-d480c0e24165 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:53.232803 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c523c3ca-627c-4a18-8aaa-171d9117a604 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:53.233783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c523c3ca-627c-4a18-8aaa-171d9117a604 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:53.235893 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:53.244817 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=14 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:53.271375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c523c3ca-627c-4a18-8aaa-171d9117a604 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:53.272848 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c523c3ca-627c-4a18-8aaa-171d9117a604 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:53.274850 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c523c3ca-627c-4a18-8aaa-171d9117a604 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:53.282091 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c523c3ca-627c-4a18-8aaa-171d9117a604 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:53.551599 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=8 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:53.785625 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-58df517e-622f-424c-84d7-d480c0e24165 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:53.794117 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-58df517e-622f-424c-84d7-d480c0e24165 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.609264 Jul 20 17:51:53.809150 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 155/297] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:53 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:53.817893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:53.818519 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:53.841356 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:53.847056 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:53.847056 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:53.847056 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:54.126861 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c523c3ca-627c-4a18-8aaa-171d9117a604 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:54.141309 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c523c3ca-627c-4a18-8aaa-171d9117a604 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1318 microversion: 2.1 time: 0.912894 Jul 20 17:51:54.141916 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 143/298] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:53 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1318 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:54.157543 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-992bf7a0-f4c6-4c11-942a-345ce6315126 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:54.159867 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-992bf7a0-f4c6-4c11-942a-345ce6315126 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:54.168632 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-992bf7a0-f4c6-4c11-942a-345ce6315126 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:54.169387 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-992bf7a0-f4c6-4c11-942a-345ce6315126 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:54.170427 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-992bf7a0-f4c6-4c11-942a-345ce6315126 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:54.171062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-992bf7a0-f4c6-4c11-942a-345ce6315126 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:54.188356 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:54.213810 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:54.217312 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:54.219361 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8c70f9c8-15c7-4a42-958d-781d503dc415 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.409277 Jul 20 17:51:54.220218 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 156/299] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:53 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:54.370738 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-992bf7a0-f4c6-4c11-942a-345ce6315126 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:54.379425 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-992bf7a0-f4c6-4c11-942a-345ce6315126 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.235245 Jul 20 17:51:54.380947 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 144/300] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:54 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:54.812897 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a1ca5762-2735-4f41-9971-87ff4b62ea02 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:54.813517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a1ca5762-2735-4f41-9971-87ff4b62ea02 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:54.824706 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a1ca5762-2735-4f41-9971-87ff4b62ea02 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:54.827366 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a1ca5762-2735-4f41-9971-87ff4b62ea02 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:54.830010 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a1ca5762-2735-4f41-9971-87ff4b62ea02 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:54.830558 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a1ca5762-2735-4f41-9971-87ff4b62ea02 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:55.162293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2f8911f9-bf0f-4504-a023-1e7291a23a3c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:55.162925 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2f8911f9-bf0f-4504-a023-1e7291a23a3c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:55.173589 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f8911f9-bf0f-4504-a023-1e7291a23a3c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:55.174881 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f8911f9-bf0f-4504-a023-1e7291a23a3c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:55.174881 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f8911f9-bf0f-4504-a023-1e7291a23a3c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:55.175249 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2f8911f9-bf0f-4504-a023-1e7291a23a3c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:55.218453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a1ca5762-2735-4f41-9971-87ff4b62ea02 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:55.236757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a1ca5762-2735-4f41-9971-87ff4b62ea02 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.429167 Jul 20 17:51:55.239139 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 157/301] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:54 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:55.249989 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:55.250728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:55.275416 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:55.275881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:55.278110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:55.280630 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:55.517776 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2f8911f9-bf0f-4504-a023-1e7291a23a3c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:55.530460 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2f8911f9-bf0f-4504-a023-1e7291a23a3c tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1508 microversion: 2.1 time: 0.372572 Jul 20 17:51:55.531504 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 145/302] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:55 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1508 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:55.536352 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c0113583-75a7-4df4-9137-91b435f7d7b4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:55.537717 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c0113583-75a7-4df4-9137-91b435f7d7b4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:55.553329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c0113583-75a7-4df4-9137-91b435f7d7b4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:55.553893 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c0113583-75a7-4df4-9137-91b435f7d7b4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:55.554747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c0113583-75a7-4df4-9137-91b435f7d7b4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:55.555821 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c0113583-75a7-4df4-9137-91b435f7d7b4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:55.573555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:55.584242 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:55.585825 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:55.590306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e707075c-32fb-464a-bc09-a82e32f7e991 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.349545 Jul 20 17:51:55.591114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 158/303] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:55 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:55.752077 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c0113583-75a7-4df4-9137-91b435f7d7b4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:55.777897 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c0113583-75a7-4df4-9137-91b435f7d7b4 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.245080 Jul 20 17:51:55.782788 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 146/304] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:55 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:56.144631 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ff339f8a-eccb-4cde-9d38-790c697348bb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Action: 'create', calling method: .version_select at 0x7f7d3da1daf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1063112530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlZeTBFtc1B5SAc1xvdNpxjkLZx3I5/rDDF9Wxhxfomv/ipPcr80EWFCU6BAfS3luIVZofJFaGljofWBO7kNs5CMLCDhOCe720aWfnUJ5fAVhfkjd5aLvNVM3fi6rLkIw=="}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:56.171123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-ff339f8a-eccb-4cde-9d38-790c697348bb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Getting quotas for project 63d0c5b02155444fb44a732c46674b8f. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:51:56.176110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-ff339f8a-eccb-4cde-9d38-790c697348bb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Getting quotas for user e72199904d9642e6bf9cacb7af568ddb and project 63d0c5b02155444fb44a732c46674b8f. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:51:56.255534 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ac5e1696-0791-4b4e-8a4e-e928b748d1c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:56.256220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ac5e1696-0791-4b4e-8a4e-e928b748d1c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:56.266048 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac5e1696-0791-4b4e-8a4e-e928b748d1c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:56.270207 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac5e1696-0791-4b4e-8a4e-e928b748d1c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:56.271113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac5e1696-0791-4b4e-8a4e-e928b748d1c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:56.271639 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ac5e1696-0791-4b4e-8a4e-e928b748d1c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:56.282625 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ff339f8a-eccb-4cde-9d38-790c697348bb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.143752 Jul 20 17:51:56.289878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 159/305] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 17:51:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:51:56.476362 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-192739742", "imageRef": "d54de556-6458-419f-a1d2-087a38fceee0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1063112530", "networks": [{"uuid": "9dd3269c-4e4d-4e01-b0c4-b8d8a573e9d7"}]}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:51:56.565043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ac5e1696-0791-4b4e-8a4e-e928b748d1c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:56.565043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:56.565043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ac5e1696-0791-4b4e-8a4e-e928b748d1c0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.308343 Jul 20 17:51:56.565043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 147/306] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:56 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:56.593887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] validate_networks() for [('9dd3269c-4e4d-4e01-b0c4-b8d8a573e9d7', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:51:56.609546 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:56.610195 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:56.618130 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:56.618970 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:56.619998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:56.620861 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:56.848217 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:56.856910 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:56.858477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:56.859720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b192fed2-67f6-4b29-913f-3886ad609d89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.254523 Jul 20 17:51:56.860631 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 148/307] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:56 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:51:56.865594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-30d335dd-a624-4d99-b8ed-ecd019142378 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:56.866203 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-30d335dd-a624-4d99-b8ed-ecd019142378 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:56.872185 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30d335dd-a624-4d99-b8ed-ecd019142378 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:56.872675 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30d335dd-a624-4d99-b8ed-ecd019142378 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:56.873526 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30d335dd-a624-4d99-b8ed-ecd019142378 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:56.873965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30d335dd-a624-4d99-b8ed-ecd019142378 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:57.116371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-30d335dd-a624-4d99-b8ed-ecd019142378 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:57.124168 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-30d335dd-a624-4d99-b8ed-ecd019142378 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.262555 Jul 20 17:51:57.124758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 149/308] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:56 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:57.186261 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:51:57.186756 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:51:57.187125 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:51:57.187524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:51:57.187927 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:51:57.196571 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:57.197014 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:57.197796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:57.198229 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:57.215419 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Getting quotas for project 63d0c5b02155444fb44a732c46674b8f. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:51:57.219852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Getting quotas for user e72199904d9642e6bf9cacb7af568ddb and project 63d0c5b02155444fb44a732c46674b8f. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:51:57.230733 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:51:57.232959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d54de556-6458-419f-a1d2-087a38fceee0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:51:57.386231 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4a7745d4-ac22-4d37-b7f9-26721cd59a1a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914256 Jul 20 17:51:57.391426 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 160/309] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:51:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:51:57.397163 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-459df13a-df20-4459-8528-7f17f3f2fda5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:57.405561 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-459df13a-df20-4459-8528-7f17f3f2fda5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:57.497945 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-459df13a-df20-4459-8528-7f17f3f2fda5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:57.506557 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-459df13a-df20-4459-8528-7f17f3f2fda5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1258 microversion: 2.1 time: 0.113598 Jul 20 17:51:57.507351 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 150/310] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:57 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1258 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:57.583662 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-daa3674c-b82e-446e-8213-6b43171a67f6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:57.585139 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-daa3674c-b82e-446e-8213-6b43171a67f6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:57.593053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-daa3674c-b82e-446e-8213-6b43171a67f6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:57.593528 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-daa3674c-b82e-446e-8213-6b43171a67f6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:57.594299 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-daa3674c-b82e-446e-8213-6b43171a67f6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:57.594729 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-daa3674c-b82e-446e-8213-6b43171a67f6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:57.824053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-daa3674c-b82e-446e-8213-6b43171a67f6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:57.833032 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-daa3674c-b82e-446e-8213-6b43171a67f6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.259066 Jul 20 17:51:57.836763 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 161/311] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:57 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:57.884955 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:57.884955 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:57.892504 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:57.893056 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:57.894021 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:57.894937 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:58.142064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b2eccf79-b68d-41a8-af0f-9ba234065537 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:58.143517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b2eccf79-b68d-41a8-af0f-9ba234065537 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:58.162868 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2eccf79-b68d-41a8-af0f-9ba234065537 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:58.163318 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2eccf79-b68d-41a8-af0f-9ba234065537 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:58.164103 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2eccf79-b68d-41a8-af0f-9ba234065537 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:58.164570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2eccf79-b68d-41a8-af0f-9ba234065537 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:58.170571 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:58.187583 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:58.189734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:58.192081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0c1b5905-3a34-4873-b4ab-8748de235c2d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.315225 Jul 20 17:51:58.192991 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 151/312] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:57 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:51:58.370524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b2eccf79-b68d-41a8-af0f-9ba234065537 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:58.387468 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b2eccf79-b68d-41a8-af0f-9ba234065537 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.250255 Jul 20 17:51:58.388071 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 162/313] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:58 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:51:58.525012 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ba639743-8bc0-4df5-9e50-ceb59d9c36f9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:58.526371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ba639743-8bc0-4df5-9e50-ceb59d9c36f9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:58.600154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ba639743-8bc0-4df5-9e50-ceb59d9c36f9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:58.611339 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ba639743-8bc0-4df5-9e50-ceb59d9c36f9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1258 microversion: 2.1 time: 0.091433 Jul 20 17:51:58.611908 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 152/314] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:58 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:58.850380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-81285c7e-edb0-440c-8913-1d3ac95dc233 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:58.851348 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-81285c7e-edb0-440c-8913-1d3ac95dc233 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:58.858879 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81285c7e-edb0-440c-8913-1d3ac95dc233 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:58.866875 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81285c7e-edb0-440c-8913-1d3ac95dc233 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:58.867750 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81285c7e-edb0-440c-8913-1d3ac95dc233 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:58.868200 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81285c7e-edb0-440c-8913-1d3ac95dc233 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:59.070203 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-81285c7e-edb0-440c-8913-1d3ac95dc233 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:59.079805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-81285c7e-edb0-440c-8913-1d3ac95dc233 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.233537 Jul 20 17:51:59.081206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 163/315] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:58 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:59.211611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:59.212226 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:59.225659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:59.226132 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:59.227017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:59.227472 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:59.417791 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cdfd497e-b4c3-49f0-b072-b88f714e3d3c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:59.418743 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cdfd497e-b4c3-49f0-b072-b88f714e3d3c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:59.428034 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cdfd497e-b4c3-49f0-b072-b88f714e3d3c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:59.431571 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cdfd497e-b4c3-49f0-b072-b88f714e3d3c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:59.431571 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cdfd497e-b4c3-49f0-b072-b88f714e3d3c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:59.431571 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cdfd497e-b4c3-49f0-b072-b88f714e3d3c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:59.432505 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:59.446530 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:59.450363 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:59.452234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a4c4423f-8a8d-4a63-9708-1db88bae2d1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.245357 Jul 20 17:51:59.452763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 153/316] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:51:59 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:51:59.628698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5ad3f968-2cf4-4e8c-9ffa-63c437912a51 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:51:59.630177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5ad3f968-2cf4-4e8c-9ffa-63c437912a51 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:51:59.647489 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ad3f968-2cf4-4e8c-9ffa-63c437912a51 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:59.651782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ad3f968-2cf4-4e8c-9ffa-63c437912a51 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:59.651782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ad3f968-2cf4-4e8c-9ffa-63c437912a51 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:51:59.651782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ad3f968-2cf4-4e8c-9ffa-63c437912a51 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:51:59.654441 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cdfd497e-b4c3-49f0-b072-b88f714e3d3c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:59.663311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cdfd497e-b4c3-49f0-b072-b88f714e3d3c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.254890 Jul 20 17:51:59.668746 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 164/317] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:59 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:51:59.777659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5ad3f968-2cf4-4e8c-9ffa-63c437912a51 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:51:59.788609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5ad3f968-2cf4-4e8c-9ffa-63c437912a51 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1262 microversion: 2.1 time: 0.163749 Jul 20 17:51:59.789333 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 154/318] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:51:59 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1262 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:00.099616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5ee978c7-c0cf-433c-b2af-6ba8b1aeaba1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:00.114303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5ee978c7-c0cf-433c-b2af-6ba8b1aeaba1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:00.114303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ee978c7-c0cf-433c-b2af-6ba8b1aeaba1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:00.116790 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ee978c7-c0cf-433c-b2af-6ba8b1aeaba1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:00.118437 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ee978c7-c0cf-433c-b2af-6ba8b1aeaba1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:00.119238 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ee978c7-c0cf-433c-b2af-6ba8b1aeaba1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:00.389885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5ee978c7-c0cf-433c-b2af-6ba8b1aeaba1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:00.401138 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5ee978c7-c0cf-433c-b2af-6ba8b1aeaba1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.305517 Jul 20 17:52:00.415461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 165/319] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:00 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:00.472004 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:00.472655 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:00.478803 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:00.479272 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:00.482446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:00.482446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:00.680495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c299b759-ee4f-433f-ae80-cb391bdd7348 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:00.681278 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c299b759-ee4f-433f-ae80-cb391bdd7348 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:00.688511 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c299b759-ee4f-433f-ae80-cb391bdd7348 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:00.688974 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c299b759-ee4f-433f-ae80-cb391bdd7348 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:00.689763 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c299b759-ee4f-433f-ae80-cb391bdd7348 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:00.690407 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c299b759-ee4f-433f-ae80-cb391bdd7348 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:00.935322 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:00.946153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:00.947315 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c299b759-ee4f-433f-ae80-cb391bdd7348 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:00.947621 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:00.949065 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-994cf105-79b8-4935-ba3b-1bc1dd96d803 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.480904 Jul 20 17:52:00.949912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 155/320] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:00 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:00.961975 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5c7b02e9-7147-4ef0-b32a-6daff032819b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:00.963148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5c7b02e9-7147-4ef0-b32a-6daff032819b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:00.965913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c299b759-ee4f-433f-ae80-cb391bdd7348 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.285833 Jul 20 17:52:00.967256 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 166/321] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:00 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:00.976028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c7b02e9-7147-4ef0-b32a-6daff032819b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:00.976028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c7b02e9-7147-4ef0-b32a-6daff032819b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:00.976028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c7b02e9-7147-4ef0-b32a-6daff032819b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:00.976028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5c7b02e9-7147-4ef0-b32a-6daff032819b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:01.066447 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5c7b02e9-7147-4ef0-b32a-6daff032819b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:01.077840 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5c7b02e9-7147-4ef0-b32a-6daff032819b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1262 microversion: 2.1 time: 0.126607 Jul 20 17:52:01.078499 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 156/322] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:00 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1262 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:01.422658 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eeb43b84-b483-4929-a655-199dbdf98475 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:01.423461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-eeb43b84-b483-4929-a655-199dbdf98475 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:01.430579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eeb43b84-b483-4929-a655-199dbdf98475 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:01.431410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eeb43b84-b483-4929-a655-199dbdf98475 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:01.432228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eeb43b84-b483-4929-a655-199dbdf98475 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:01.432700 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eeb43b84-b483-4929-a655-199dbdf98475 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:01.618530 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-eeb43b84-b483-4929-a655-199dbdf98475 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:01.622609 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=100 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:01.629020 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-eeb43b84-b483-4929-a655-199dbdf98475 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.211133 Jul 20 17:52:01.630381 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 167/323] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:01 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:01.972508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:01.973318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:01.987950 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:01.988282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1539908c-ff0a-45a5-b09c-ec3c2276dee1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:01.988686 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:01.988774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1539908c-ff0a-45a5-b09c-ec3c2276dee1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:01.988862 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:01.988862 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:01.988997 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:01.993436 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1539908c-ff0a-45a5-b09c-ec3c2276dee1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:01.993916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1539908c-ff0a-45a5-b09c-ec3c2276dee1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:01.994660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1539908c-ff0a-45a5-b09c-ec3c2276dee1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:01.995065 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1539908c-ff0a-45a5-b09c-ec3c2276dee1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:02.329168 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1539908c-ff0a-45a5-b09c-ec3c2276dee1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:02.333508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:02.345341 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:02.347405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:02.348699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1539908c-ff0a-45a5-b09c-ec3c2276dee1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.361646 Jul 20 17:52:02.349968 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 168/324] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:01 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:02.361683 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4fe4c554-4616-4435-8645-0363c2efaad5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:02.361683 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4fe4c554-4616-4435-8645-0363c2efaad5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:02.362587 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-48adae2b-b37b-4991-8f57-010b77bb2e1e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1740 microversion: 2.20 time: 0.382391 Jul 20 17:52:02.363577 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 157/325] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:01 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1740 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:02.375507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fe4c554-4616-4435-8645-0363c2efaad5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:02.376942 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fe4c554-4616-4435-8645-0363c2efaad5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:02.378107 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fe4c554-4616-4435-8645-0363c2efaad5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:02.378790 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fe4c554-4616-4435-8645-0363c2efaad5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:02.448496 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4fe4c554-4616-4435-8645-0363c2efaad5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:02.455012 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4fe4c554-4616-4435-8645-0363c2efaad5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1328 microversion: 2.1 time: 0.102382 Jul 20 17:52:02.455948 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 169/326] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:02 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:02.646566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7ef3f9df-2102-4afb-8500-57532c6a6c50 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:02.647101 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7ef3f9df-2102-4afb-8500-57532c6a6c50 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:02.653042 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ef3f9df-2102-4afb-8500-57532c6a6c50 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:02.658365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ef3f9df-2102-4afb-8500-57532c6a6c50 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:02.658365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ef3f9df-2102-4afb-8500-57532c6a6c50 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:02.658365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ef3f9df-2102-4afb-8500-57532c6a6c50 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:02.873021 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7ef3f9df-2102-4afb-8500-57532c6a6c50 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:02.880563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7ef3f9df-2102-4afb-8500-57532c6a6c50 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.238131 Jul 20 17:52:02.881133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 158/327] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:02 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:03.366126 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ba46c21d-96a5-4433-b416-354a8c9c730a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:03.366880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ba46c21d-96a5-4433-b416-354a8c9c730a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:03.375119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba46c21d-96a5-4433-b416-354a8c9c730a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:03.375660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba46c21d-96a5-4433-b416-354a8c9c730a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:03.376548 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba46c21d-96a5-4433-b416-354a8c9c730a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:03.377329 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba46c21d-96a5-4433-b416-354a8c9c730a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:03.381364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:03.381986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:03.412377 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:03.412377 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:03.413094 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:03.413195 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:03.619574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ba46c21d-96a5-4433-b416-354a8c9c730a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:03.627746 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ba46c21d-96a5-4433-b416-354a8c9c730a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.265726 Jul 20 17:52:03.628808 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 170/328] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:03 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:03.635017 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eac26f3c-34bd-4d8c-b7a3-2de7118c4d62 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:03.637398 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-eac26f3c-34bd-4d8c-b7a3-2de7118c4d62 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:03.651742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eac26f3c-34bd-4d8c-b7a3-2de7118c4d62 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:03.652209 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eac26f3c-34bd-4d8c-b7a3-2de7118c4d62 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:03.653698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eac26f3c-34bd-4d8c-b7a3-2de7118c4d62 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:03.654944 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eac26f3c-34bd-4d8c-b7a3-2de7118c4d62 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:03.723195 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:03.735004 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:03.737566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:03.744959 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-51ed2b3e-d1dd-45ea-adfe-d876256db020 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.367489 Jul 20 17:52:03.757355 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 159/329] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:03 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:03.898246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-09962513-5ccb-46d5-8844-13284fc113d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:03.899230 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-09962513-5ccb-46d5-8844-13284fc113d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:03.905685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09962513-5ccb-46d5-8844-13284fc113d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:03.906161 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09962513-5ccb-46d5-8844-13284fc113d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:03.913831 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09962513-5ccb-46d5-8844-13284fc113d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:03.913831 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09962513-5ccb-46d5-8844-13284fc113d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:03.918394 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-eac26f3c-34bd-4d8c-b7a3-2de7118c4d62 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:03.926208 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-eac26f3c-34bd-4d8c-b7a3-2de7118c4d62 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.296393 Jul 20 17:52:03.926784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 171/330] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:03 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:04.049766 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-09962513-5ccb-46d5-8844-13284fc113d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:04.054612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-09962513-5ccb-46d5-8844-13284fc113d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.160277 Jul 20 17:52:04.055177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 160/331] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:03 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:04.131573 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-034c1abe-339f-4cf7-9b56-f3286594be10 req-a8b5d13c-5e0e-49af-ae3e-93e15d6c0636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a959b594-9ce2-4fb1-b648-4016dfecb1b1", "name": "network-vif-plugged", "status": "completed", "tag": "ea69bd29-73fa-4c45-8d4a-013f8382d993"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:04.139921 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-034c1abe-339f-4cf7-9b56-f3286594be10 req-a8b5d13c-5e0e-49af-ae3e-93e15d6c0636 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:04.140363 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-034c1abe-339f-4cf7-9b56-f3286594be10 req-a8b5d13c-5e0e-49af-ae3e-93e15d6c0636 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:04.151116 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-034c1abe-339f-4cf7-9b56-f3286594be10 req-a8b5d13c-5e0e-49af-ae3e-93e15d6c0636 service nova] Creating event network-vif-plugged:ea69bd29-73fa-4c45-8d4a-013f8382d993 for instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 on hv-cinder-84984 Jul 20 17:52:04.156675 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-034c1abe-339f-4cf7-9b56-f3286594be10 req-a8b5d13c-5e0e-49af-ae3e-93e15d6c0636 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028980 Jul 20 17:52:04.157244 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 172/332] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:52:04.650226 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-54a23048-7c58-4614-b406-3e858425517e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:04.650226 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-54a23048-7c58-4614-b406-3e858425517e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:04.656110 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54a23048-7c58-4614-b406-3e858425517e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:04.656787 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54a23048-7c58-4614-b406-3e858425517e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:04.665368 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54a23048-7c58-4614-b406-3e858425517e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:04.665854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54a23048-7c58-4614-b406-3e858425517e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:04.767219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:04.768295 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:04.774538 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:04.775066 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:04.776062 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:04.776567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:04.911184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-54a23048-7c58-4614-b406-3e858425517e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:04.926829 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-54a23048-7c58-4614-b406-3e858425517e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.285364 Jul 20 17:52:04.928335 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 161/333] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:04 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:04.947933 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6f9cab59-ca78-4402-b792-c6a7c975a001 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:04.947933 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6f9cab59-ca78-4402-b792-c6a7c975a001 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:04.957372 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f9cab59-ca78-4402-b792-c6a7c975a001 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:04.959202 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f9cab59-ca78-4402-b792-c6a7c975a001 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:04.960790 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f9cab59-ca78-4402-b792-c6a7c975a001 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:04.962581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f9cab59-ca78-4402-b792-c6a7c975a001 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:04.986875 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:04.997849 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:05.002124 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:05.004937 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3b3b46d9-7d16-43fa-8c6a-491703dd41c5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.244906 Jul 20 17:52:05.006604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 173/334] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:04 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:05.073093 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0e2e98e2-a171-42a1-bc47-895ce843cac0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:05.073202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0e2e98e2-a171-42a1-bc47-895ce843cac0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:05.084181 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e2e98e2-a171-42a1-bc47-895ce843cac0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:05.084667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e2e98e2-a171-42a1-bc47-895ce843cac0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:05.085672 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e2e98e2-a171-42a1-bc47-895ce843cac0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:05.086277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e2e98e2-a171-42a1-bc47-895ce843cac0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:05.140895 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6f9cab59-ca78-4402-b792-c6a7c975a001 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:05.179670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6f9cab59-ca78-4402-b792-c6a7c975a001 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.237977 Jul 20 17:52:05.181658 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 162/335] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:04 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:05.292362 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0e2e98e2-a171-42a1-bc47-895ce843cac0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:05.299887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0e2e98e2-a171-42a1-bc47-895ce843cac0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.231627 Jul 20 17:52:05.300932 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 174/336] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:05 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:05.944878 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0231972d-bc11-4e87-a71a-acfb933b2a3e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:05.946151 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0231972d-bc11-4e87-a71a-acfb933b2a3e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:05.955043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0231972d-bc11-4e87-a71a-acfb933b2a3e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:05.955770 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0231972d-bc11-4e87-a71a-acfb933b2a3e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:05.957500 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0231972d-bc11-4e87-a71a-acfb933b2a3e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:05.958300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0231972d-bc11-4e87-a71a-acfb933b2a3e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:06.023454 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:06.024842 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:06.032180 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:06.032797 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:06.033640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:06.034146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:06.159074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0231972d-bc11-4e87-a71a-acfb933b2a3e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:06.159074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0231972d-bc11-4e87-a71a-acfb933b2a3e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.217075 Jul 20 17:52:06.159074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 163/337] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:05 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:06.208255 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0fa23b65-b1f3-4084-bf56-ea963ba8d0c4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:06.209219 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0fa23b65-b1f3-4084-bf56-ea963ba8d0c4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:06.218610 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fa23b65-b1f3-4084-bf56-ea963ba8d0c4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:06.218858 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fa23b65-b1f3-4084-bf56-ea963ba8d0c4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:06.220010 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fa23b65-b1f3-4084-bf56-ea963ba8d0c4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:06.220812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fa23b65-b1f3-4084-bf56-ea963ba8d0c4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:06.342204 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:06.342204 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:06.342532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:06.342532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c55e5358-929f-4e47-8989-30559772e3b8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.315167 Jul 20 17:52:06.342532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 175/338] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:06 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:06.342532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-35e9b89c-8bb7-4bcc-9e44-0059e7d0f3a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:06.342829 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-35e9b89c-8bb7-4bcc-9e44-0059e7d0f3a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:06.359747 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e9b89c-8bb7-4bcc-9e44-0059e7d0f3a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:06.360724 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e9b89c-8bb7-4bcc-9e44-0059e7d0f3a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:06.361850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e9b89c-8bb7-4bcc-9e44-0059e7d0f3a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:06.362682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e9b89c-8bb7-4bcc-9e44-0059e7d0f3a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:06.559658 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0fa23b65-b1f3-4084-bf56-ea963ba8d0c4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:06.568382 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0fa23b65-b1f3-4084-bf56-ea963ba8d0c4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.364872 Jul 20 17:52:06.569774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 164/339] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:06 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:06.606424 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-35e9b89c-8bb7-4bcc-9e44-0059e7d0f3a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:06.614820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-35e9b89c-8bb7-4bcc-9e44-0059e7d0f3a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.278684 Jul 20 17:52:06.615818 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 176/340] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:06 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:07.176950 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a08f4fd2-ea20-40b9-b7db-91bff2c5ba4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:07.177757 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a08f4fd2-ea20-40b9-b7db-91bff2c5ba4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:07.194075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a08f4fd2-ea20-40b9-b7db-91bff2c5ba4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:07.194529 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a08f4fd2-ea20-40b9-b7db-91bff2c5ba4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:07.195312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a08f4fd2-ea20-40b9-b7db-91bff2c5ba4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:07.195752 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a08f4fd2-ea20-40b9-b7db-91bff2c5ba4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:07.377025 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:07.378248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:07.387293 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:07.388343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=10 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:07.394656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:07.394656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:07.394656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:07.394656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:07.395187 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a08f4fd2-ea20-40b9-b7db-91bff2c5ba4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:07.402341 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a08f4fd2-ea20-40b9-b7db-91bff2c5ba4d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.229864 Jul 20 17:52:07.411182 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 165/341] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:07 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:07.586582 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-07e27f38-14c2-4b66-be38-2671632da4e6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:07.587532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:07.588318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-07e27f38-14c2-4b66-be38-2671632da4e6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:07.596885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:07.597911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:07.599153 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3840a6ee-740b-4900-8afc-155a034ea81c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.227709 Jul 20 17:52:07.599904 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 177/342] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:07 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:07.612863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-07e27f38-14c2-4b66-be38-2671632da4e6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:07.615407 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-07e27f38-14c2-4b66-be38-2671632da4e6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:07.630235 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-07e27f38-14c2-4b66-be38-2671632da4e6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:07.630235 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-07e27f38-14c2-4b66-be38-2671632da4e6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:07.636585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1c797cbd-6c78-496b-93a9-149e01f6be26 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:07.637185 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1c797cbd-6c78-496b-93a9-149e01f6be26 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:07.650513 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1c797cbd-6c78-496b-93a9-149e01f6be26 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:07.650990 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1c797cbd-6c78-496b-93a9-149e01f6be26 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:07.651823 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1c797cbd-6c78-496b-93a9-149e01f6be26 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:07.653493 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1c797cbd-6c78-496b-93a9-149e01f6be26 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:07.667463 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:07.883511 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-07e27f38-14c2-4b66-be38-2671632da4e6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:07.905519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-07e27f38-14c2-4b66-be38-2671632da4e6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.323111 Jul 20 17:52:07.913269 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 166/343] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:07 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:07.953567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1c797cbd-6c78-496b-93a9-149e01f6be26 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:07.955787 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-9b6118d7-8ccc-44f3-8393-ed55454071c3 req-9afc1de9-2326-470d-b567-257dc0b47bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b246c9-d9df-4348-9d5a-61c1170b1951", "name": "network-vif-unplugged", "status": "completed", "tag": "c0861927-5eef-4dee-a02c-a3bed737a580"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:07.971947 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1c797cbd-6c78-496b-93a9-149e01f6be26 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.339138 Jul 20 17:52:07.984135 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 178/344] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:07 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:07.988104 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-9b6118d7-8ccc-44f3-8393-ed55454071c3 req-9afc1de9-2326-470d-b567-257dc0b47bc6 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:07.996941 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-9b6118d7-8ccc-44f3-8393-ed55454071c3 req-9afc1de9-2326-470d-b567-257dc0b47bc6 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:08.045459 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-9b6118d7-8ccc-44f3-8393-ed55454071c3 req-9afc1de9-2326-470d-b567-257dc0b47bc6 service nova] Creating event network-vif-unplugged:c0861927-5eef-4dee-a02c-a3bed737a580 for instance 45b246c9-d9df-4348-9d5a-61c1170b1951 on hv-cinder-84984 Jul 20 17:52:08.052316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-9b6118d7-8ccc-44f3-8393-ed55454071c3 req-9afc1de9-2326-470d-b567-257dc0b47bc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100403 Jul 20 17:52:08.058164 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 167/345] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:52:08.419378 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ebae2a04-3d6a-44d8-9ac9-180c1092f0f1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:08.420763 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ebae2a04-3d6a-44d8-9ac9-180c1092f0f1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:08.427305 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ebae2a04-3d6a-44d8-9ac9-180c1092f0f1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:08.427742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ebae2a04-3d6a-44d8-9ac9-180c1092f0f1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:08.428544 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ebae2a04-3d6a-44d8-9ac9-180c1092f0f1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:08.428981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ebae2a04-3d6a-44d8-9ac9-180c1092f0f1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:08.570406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ebae2a04-3d6a-44d8-9ac9-180c1092f0f1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:08.578776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ebae2a04-3d6a-44d8-9ac9-180c1092f0f1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.163265 Jul 20 17:52:08.579347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 179/346] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:08 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:08.619327 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:08.620029 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:08.622620 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=4 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:08.626623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:08.628998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:08.629843 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:08.630832 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:08.631454 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:08.786483 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:08.795747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:08.797710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:08.798897 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-55244be7-dd57-4a56-8dc0-ae724f166476 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.184469 Jul 20 17:52:08.799461 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 168/347] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:08 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:08.929506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2ed0a196-bc83-4b6e-a2e2-0543190de532 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:08.929506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2ed0a196-bc83-4b6e-a2e2-0543190de532 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:08.930596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ed0a196-bc83-4b6e-a2e2-0543190de532 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:08.931059 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ed0a196-bc83-4b6e-a2e2-0543190de532 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:08.932042 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ed0a196-bc83-4b6e-a2e2-0543190de532 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:08.932691 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ed0a196-bc83-4b6e-a2e2-0543190de532 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:08.989482 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9e9ef74c-59bb-4d68-949c-09ae4862b464 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:08.990128 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9e9ef74c-59bb-4d68-949c-09ae4862b464 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:09.006213 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e9ef74c-59bb-4d68-949c-09ae4862b464 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:09.006678 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e9ef74c-59bb-4d68-949c-09ae4862b464 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:09.007477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e9ef74c-59bb-4d68-949c-09ae4862b464 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:09.007912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9e9ef74c-59bb-4d68-949c-09ae4862b464 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:09.144902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2ed0a196-bc83-4b6e-a2e2-0543190de532 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:09.154885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2ed0a196-bc83-4b6e-a2e2-0543190de532 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.234602 Jul 20 17:52:09.154885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 180/348] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:08 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:09.208060 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9e9ef74c-59bb-4d68-949c-09ae4862b464 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:09.216119 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9e9ef74c-59bb-4d68-949c-09ae4862b464 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.230525 Jul 20 17:52:09.218025 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 169/349] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:08 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:09.595096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6193bde7-fdd0-4b9f-b431-1e02751f5516 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:09.595695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6193bde7-fdd0-4b9f-b431-1e02751f5516 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:09.602478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6193bde7-fdd0-4b9f-b431-1e02751f5516 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:09.602969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6193bde7-fdd0-4b9f-b431-1e02751f5516 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:09.603729 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6193bde7-fdd0-4b9f-b431-1e02751f5516 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:09.604186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6193bde7-fdd0-4b9f-b431-1e02751f5516 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:09.754915 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6193bde7-fdd0-4b9f-b431-1e02751f5516 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:09.762910 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6193bde7-fdd0-4b9f-b431-1e02751f5516 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.171582 Jul 20 17:52:09.763857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 181/350] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:09 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:09.818460 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:09.819058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:09.826406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:09.826862 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:09.827709 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:09.828262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:09.984210 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:09.992412 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:09.993969 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:09.995121 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-baf4c38a-3efe-42cf-b169-165c195f3158 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.180842 Jul 20 17:52:09.995758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 170/351] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:09 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:10.171400 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7ffd9f69-5f7b-4a09-aace-60aea75f68c3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:10.173346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7ffd9f69-5f7b-4a09-aace-60aea75f68c3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:10.178871 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ffd9f69-5f7b-4a09-aace-60aea75f68c3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:10.179540 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ffd9f69-5f7b-4a09-aace-60aea75f68c3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:10.180536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ffd9f69-5f7b-4a09-aace-60aea75f68c3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:10.181126 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ffd9f69-5f7b-4a09-aace-60aea75f68c3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:10.234919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d266a722-a1cf-4f43-acc1-d6cbf4592261 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:10.236500 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d266a722-a1cf-4f43-acc1-d6cbf4592261 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:10.254683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d266a722-a1cf-4f43-acc1-d6cbf4592261 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:10.255153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d266a722-a1cf-4f43-acc1-d6cbf4592261 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:10.255953 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d266a722-a1cf-4f43-acc1-d6cbf4592261 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:10.257293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d266a722-a1cf-4f43-acc1-d6cbf4592261 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:10.398320 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7ffd9f69-5f7b-4a09-aace-60aea75f68c3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:10.406843 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7ffd9f69-5f7b-4a09-aace-60aea75f68c3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.239923 Jul 20 17:52:10.416726 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 182/352] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:10 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:10.447579 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d266a722-a1cf-4f43-acc1-d6cbf4592261 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:10.450694 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d266a722-a1cf-4f43-acc1-d6cbf4592261 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.221183 Jul 20 17:52:10.451846 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 171/353] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:10 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:10.780838 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-640ab7bc-d248-48a4-a293-d17717cac7d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:10.781613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-640ab7bc-d248-48a4-a293-d17717cac7d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:10.788327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-640ab7bc-d248-48a4-a293-d17717cac7d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:10.788805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-640ab7bc-d248-48a4-a293-d17717cac7d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:10.789589 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-640ab7bc-d248-48a4-a293-d17717cac7d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:10.790022 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-640ab7bc-d248-48a4-a293-d17717cac7d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:10.945960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-640ab7bc-d248-48a4-a293-d17717cac7d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:10.954882 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-640ab7bc-d248-48a4-a293-d17717cac7d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.179140 Jul 20 17:52:10.955391 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 183/354] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:10 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:11.013214 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:11.014373 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:11.021361 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:11.021809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:11.022598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:11.023032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:11.188054 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:11.197833 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:11.199618 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:11.201869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-93cbc371-37bd-447a-b172-888d1e04ba8d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.191966 Jul 20 17:52:11.202885 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 172/355] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:11 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:11.425669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-618fed5e-1338-400e-ae95-9e0d0af82276 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:11.426604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-618fed5e-1338-400e-ae95-9e0d0af82276 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:11.436496 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-618fed5e-1338-400e-ae95-9e0d0af82276 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:11.442181 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-618fed5e-1338-400e-ae95-9e0d0af82276 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:11.443574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-618fed5e-1338-400e-ae95-9e0d0af82276 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:11.444253 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-618fed5e-1338-400e-ae95-9e0d0af82276 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:11.469686 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b8ad7cc1-75cd-4755-956d-85b10958ac30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:11.470237 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b8ad7cc1-75cd-4755-956d-85b10958ac30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:11.476526 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8ad7cc1-75cd-4755-956d-85b10958ac30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:11.476971 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8ad7cc1-75cd-4755-956d-85b10958ac30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:11.478118 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8ad7cc1-75cd-4755-956d-85b10958ac30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:11.478552 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8ad7cc1-75cd-4755-956d-85b10958ac30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:11.684487 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-618fed5e-1338-400e-ae95-9e0d0af82276 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:11.692980 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-618fed5e-1338-400e-ae95-9e0d0af82276 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.273417 Jul 20 17:52:11.703468 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 184/356] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:11 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:11.709539 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b8ad7cc1-75cd-4755-956d-85b10958ac30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:11.719418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b8ad7cc1-75cd-4755-956d-85b10958ac30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.254413 Jul 20 17:52:11.720228 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 173/357] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:11 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:11.973288 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-52af3913-62d7-484d-9516-ac124da0ee36 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:11.974326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-52af3913-62d7-484d-9516-ac124da0ee36 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:11.981113 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52af3913-62d7-484d-9516-ac124da0ee36 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:11.981678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52af3913-62d7-484d-9516-ac124da0ee36 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:11.987095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52af3913-62d7-484d-9516-ac124da0ee36 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:11.987095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52af3913-62d7-484d-9516-ac124da0ee36 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:11.988013 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=100 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:12.120067 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-52af3913-62d7-484d-9516-ac124da0ee36 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:12.129220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-52af3913-62d7-484d-9516-ac124da0ee36 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.160559 Jul 20 17:52:12.129895 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 185/358] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:11 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:12.221126 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:12.222515 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:12.229366 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:12.229749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:12.230519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:12.230954 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:12.373563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:12.382133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:12.383687 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:12.384884 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-719aa95c-21f0-486a-89a2-16b3845617ba tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.168801 Jul 20 17:52:12.385446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 174/359] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:12 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:12.711166 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4aee481c-f099-413d-8245-e0e3e5c3f258 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:12.711898 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4aee481c-f099-413d-8245-e0e3e5c3f258 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:12.718708 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4aee481c-f099-413d-8245-e0e3e5c3f258 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:12.719165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4aee481c-f099-413d-8245-e0e3e5c3f258 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:12.719973 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4aee481c-f099-413d-8245-e0e3e5c3f258 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:12.720413 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4aee481c-f099-413d-8245-e0e3e5c3f258 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:12.736855 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-040954b1-d54a-4cb0-8e47-1f70550eadd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:12.737741 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-040954b1-d54a-4cb0-8e47-1f70550eadd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:12.744333 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-040954b1-d54a-4cb0-8e47-1f70550eadd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:12.745327 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-040954b1-d54a-4cb0-8e47-1f70550eadd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:12.746291 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-040954b1-d54a-4cb0-8e47-1f70550eadd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:12.753106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-040954b1-d54a-4cb0-8e47-1f70550eadd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:12.951909 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4aee481c-f099-413d-8245-e0e3e5c3f258 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:12.960091 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-040954b1-d54a-4cb0-8e47-1f70550eadd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:12.960751 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4aee481c-f099-413d-8245-e0e3e5c3f258 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.253911 Jul 20 17:52:12.961620 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 186/360] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:12 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:12.968676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-040954b1-d54a-4cb0-8e47-1f70550eadd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.236223 Jul 20 17:52:12.969276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 175/361] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:12 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:13.146268 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1510d7c9-f2fb-4169-95d2-a658a963b178 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:13.146883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1510d7c9-f2fb-4169-95d2-a658a963b178 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:13.154688 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1510d7c9-f2fb-4169-95d2-a658a963b178 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:13.155266 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1510d7c9-f2fb-4169-95d2-a658a963b178 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:13.156026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1510d7c9-f2fb-4169-95d2-a658a963b178 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:13.156471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1510d7c9-f2fb-4169-95d2-a658a963b178 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:13.296973 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1510d7c9-f2fb-4169-95d2-a658a963b178 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:13.304408 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1510d7c9-f2fb-4169-95d2-a658a963b178 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.161931 Jul 20 17:52:13.305016 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 187/362] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:13 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:13.402695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:13.403340 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:13.410454 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:13.410906 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:13.411670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:13.412109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:13.540811 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:13.550763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:13.553548 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:13.554701 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-54632ff3-5409-4ca3-aebe-c9b859d64098 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.155923 Jul 20 17:52:13.555271 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 176/363] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:13 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:13.983390 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-523be683-aeca-481d-bc01-da9f0e351f74 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:13.984848 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-523be683-aeca-481d-bc01-da9f0e351f74 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:13.990791 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-20eb7012-c233-4254-8a02-fdabdd76827b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:13.991671 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-20eb7012-c233-4254-8a02-fdabdd76827b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:13.997393 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-523be683-aeca-481d-bc01-da9f0e351f74 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:13.998505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-523be683-aeca-481d-bc01-da9f0e351f74 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:13.999126 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20eb7012-c233-4254-8a02-fdabdd76827b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:13.999647 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20eb7012-c233-4254-8a02-fdabdd76827b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:14.000057 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-523be683-aeca-481d-bc01-da9f0e351f74 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:14.000609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20eb7012-c233-4254-8a02-fdabdd76827b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:14.000780 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-523be683-aeca-481d-bc01-da9f0e351f74 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:14.001027 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20eb7012-c233-4254-8a02-fdabdd76827b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:14.217758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-20eb7012-c233-4254-8a02-fdabdd76827b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:14.221966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-523be683-aeca-481d-bc01-da9f0e351f74 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:14.225374 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-20eb7012-c233-4254-8a02-fdabdd76827b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.239063 Jul 20 17:52:14.225942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 177/364] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:13 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:14.229712 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-523be683-aeca-481d-bc01-da9f0e351f74 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.250485 Jul 20 17:52:14.230278 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 188/365] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:13 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:14.321618 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c71af4ee-1da2-45b7-84c9-05acbea248a3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:14.322152 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c71af4ee-1da2-45b7-84c9-05acbea248a3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:14.328232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c71af4ee-1da2-45b7-84c9-05acbea248a3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:14.328711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c71af4ee-1da2-45b7-84c9-05acbea248a3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:14.329475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c71af4ee-1da2-45b7-84c9-05acbea248a3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:14.329907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c71af4ee-1da2-45b7-84c9-05acbea248a3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:14.461262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c71af4ee-1da2-45b7-84c9-05acbea248a3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:14.469216 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c71af4ee-1da2-45b7-84c9-05acbea248a3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.151481 Jul 20 17:52:14.473563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 178/366] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:14 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:14.572843 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:14.573395 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:14.579359 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:14.579810 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:14.580593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:14.581031 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:14.708990 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:14.717328 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:14.718825 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:14.719965 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-66a2047d-bc4e-4e05-8464-384f3fa40747 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.151129 Jul 20 17:52:14.720540 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 189/367] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:14 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:15.242391 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d70d53a8-c6ba-454f-88ac-27a65894c429 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:15.242999 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d70d53a8-c6ba-454f-88ac-27a65894c429 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:15.246537 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5b604912-0f76-4ee2-9761-1acffad08b98 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:15.247142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5b604912-0f76-4ee2-9761-1acffad08b98 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:15.249393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d70d53a8-c6ba-454f-88ac-27a65894c429 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:15.249845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d70d53a8-c6ba-454f-88ac-27a65894c429 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:15.250607 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d70d53a8-c6ba-454f-88ac-27a65894c429 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:15.251044 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d70d53a8-c6ba-454f-88ac-27a65894c429 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:15.253568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5b604912-0f76-4ee2-9761-1acffad08b98 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:15.254011 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5b604912-0f76-4ee2-9761-1acffad08b98 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:15.254758 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5b604912-0f76-4ee2-9761-1acffad08b98 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:15.255188 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5b604912-0f76-4ee2-9761-1acffad08b98 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:15.442572 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d70d53a8-c6ba-454f-88ac-27a65894c429 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:15.445912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5b604912-0f76-4ee2-9761-1acffad08b98 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:15.450028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d70d53a8-c6ba-454f-88ac-27a65894c429 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.211515 Jul 20 17:52:15.450620 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 179/368] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:15 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:15.453820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5b604912-0f76-4ee2-9761-1acffad08b98 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.211010 Jul 20 17:52:15.454379 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 190/369] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:15 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:15.486058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e1396199-296f-4323-b7ef-fc0ab20ad9e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:15.486667 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e1396199-296f-4323-b7ef-fc0ab20ad9e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:15.492559 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e1396199-296f-4323-b7ef-fc0ab20ad9e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:15.492944 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e1396199-296f-4323-b7ef-fc0ab20ad9e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:15.493692 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e1396199-296f-4323-b7ef-fc0ab20ad9e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:15.494118 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e1396199-296f-4323-b7ef-fc0ab20ad9e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:15.628252 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e1396199-296f-4323-b7ef-fc0ab20ad9e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:15.635530 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e1396199-296f-4323-b7ef-fc0ab20ad9e8 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.153397 Jul 20 17:52:15.636084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 180/370] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:15 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:15.738476 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:15.739119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:15.746443 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:15.746857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:15.747616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:15.749188 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:16.034388 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:16.044413 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:16.047071 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:16.047980 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ccd46923-c146-463f-844a-f94ce3a88c30 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.313432 Jul 20 17:52:16.048846 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 191/371] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:15 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:16.466488 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fa135a01-de89-4abc-8bfe-db42013dc175 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:16.467762 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fa135a01-de89-4abc-8bfe-db42013dc175 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:16.471298 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-375c7dbd-80b2-4a96-a235-143c4f0a5ffb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:16.472005 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-375c7dbd-80b2-4a96-a235-143c4f0a5ffb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:16.475722 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fa135a01-de89-4abc-8bfe-db42013dc175 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:16.475722 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fa135a01-de89-4abc-8bfe-db42013dc175 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:16.476345 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fa135a01-de89-4abc-8bfe-db42013dc175 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:16.476863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fa135a01-de89-4abc-8bfe-db42013dc175 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:16.478750 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-375c7dbd-80b2-4a96-a235-143c4f0a5ffb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:16.479283 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-375c7dbd-80b2-4a96-a235-143c4f0a5ffb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:16.480286 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-375c7dbd-80b2-4a96-a235-143c4f0a5ffb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:16.481103 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-375c7dbd-80b2-4a96-a235-143c4f0a5ffb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:16.734123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-375c7dbd-80b2-4a96-a235-143c4f0a5ffb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:16.741893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-375c7dbd-80b2-4a96-a235-143c4f0a5ffb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.276134 Jul 20 17:52:16.742674 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 192/372] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:16 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:16.747579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-846f650a-3233-4dad-b091-f8e379e09156 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:16.748714 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-846f650a-3233-4dad-b091-f8e379e09156 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:16.754715 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-846f650a-3233-4dad-b091-f8e379e09156 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:16.755170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-846f650a-3233-4dad-b091-f8e379e09156 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:16.755940 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-846f650a-3233-4dad-b091-f8e379e09156 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:16.756381 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-846f650a-3233-4dad-b091-f8e379e09156 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:16.757529 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fa135a01-de89-4abc-8bfe-db42013dc175 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:16.767648 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fa135a01-de89-4abc-8bfe-db42013dc175 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1522 microversion: 2.1 time: 0.304979 Jul 20 17:52:16.777253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 181/373] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:16 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:16.986240 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-846f650a-3233-4dad-b091-f8e379e09156 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:17.002201 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-846f650a-3233-4dad-b091-f8e379e09156 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.257971 Jul 20 17:52:17.002994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 193/374] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:16 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:17.067006 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:17.067625 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:17.074030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:17.074480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:17.075257 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:17.075694 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:17.270057 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:17.278287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:17.280483 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:17.281683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7391a534-e17c-4de2-9509-7c0004a9fba8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.218441 Jul 20 17:52:17.282239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 182/375] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:17 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:17.396869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-029c7ad7-7002-4d10-bc98-ee127b440a7c req-0331080c-f987-484a-8e87-e9208a5e4079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3192a390-865f-408d-adb6-01f03593249c", "tag": "05bc7328-58f7-4b9a-89df-2347f267ebb3"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:17.410048 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-029c7ad7-7002-4d10-bc98-ee127b440a7c req-0331080c-f987-484a-8e87-e9208a5e4079 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:17.410804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-029c7ad7-7002-4d10-bc98-ee127b440a7c req-0331080c-f987-484a-8e87-e9208a5e4079 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:17.426768 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-029c7ad7-7002-4d10-bc98-ee127b440a7c req-0331080c-f987-484a-8e87-e9208a5e4079 service nova] Creating event network-changed:05bc7328-58f7-4b9a-89df-2347f267ebb3 for instance 3192a390-865f-408d-adb6-01f03593249c on hv-cinder-84984 Jul 20 17:52:17.431969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-029c7ad7-7002-4d10-bc98-ee127b440a7c req-0331080c-f987-484a-8e87-e9208a5e4079 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041788 Jul 20 17:52:17.432807 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 194/376] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:52:17.759538 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6d1bc12f-ccaf-47dc-a3e0-f868593ec384 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:17.760283 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6d1bc12f-ccaf-47dc-a3e0-f868593ec384 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:17.767173 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6d1bc12f-ccaf-47dc-a3e0-f868593ec384 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:17.767673 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6d1bc12f-ccaf-47dc-a3e0-f868593ec384 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:17.768482 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6d1bc12f-ccaf-47dc-a3e0-f868593ec384 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:17.768916 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6d1bc12f-ccaf-47dc-a3e0-f868593ec384 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:17.785699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-48285279-28cc-4984-aa61-12f4f1acf8d5 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:17.786491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-48285279-28cc-4984-aa61-12f4f1acf8d5 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:17.793584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-48285279-28cc-4984-aa61-12f4f1acf8d5 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:17.794121 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-48285279-28cc-4984-aa61-12f4f1acf8d5 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:17.795528 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-48285279-28cc-4984-aa61-12f4f1acf8d5 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:17.796045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-48285279-28cc-4984-aa61-12f4f1acf8d5 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:18.056779 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6d1bc12f-ccaf-47dc-a3e0-f868593ec384 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:18.059009 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:18.060487 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-48285279-28cc-4984-aa61-12f4f1acf8d5 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:18.065281 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6d1bc12f-ccaf-47dc-a3e0-f868593ec384 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.309783 Jul 20 17:52:18.065862 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 183/377] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:17 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:18.068701 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-48285279-28cc-4984-aa61-12f4f1acf8d5 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1502 microversion: 2.1 time: 0.287198 Jul 20 17:52:18.069979 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 195/378] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:17 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:18.070269 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-48d7bb93-05d5-4326-bd21-4e2a55e71b11 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:18.070903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-48d7bb93-05d5-4326-bd21-4e2a55e71b11 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:18.077464 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48d7bb93-05d5-4326-bd21-4e2a55e71b11 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:18.077972 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48d7bb93-05d5-4326-bd21-4e2a55e71b11 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:18.078949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48d7bb93-05d5-4326-bd21-4e2a55e71b11 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:18.079386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-48d7bb93-05d5-4326-bd21-4e2a55e71b11 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:18.091313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cd9d4665-daa0-4ca8-9397-a9949228d103 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:18.092560 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cd9d4665-daa0-4ca8-9397-a9949228d103 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:18.098869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cd9d4665-daa0-4ca8-9397-a9949228d103 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:18.099610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cd9d4665-daa0-4ca8-9397-a9949228d103 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:18.100683 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cd9d4665-daa0-4ca8-9397-a9949228d103 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:18.101101 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cd9d4665-daa0-4ca8-9397-a9949228d103 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:18.294631 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-48d7bb93-05d5-4326-bd21-4e2a55e71b11 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:18.302693 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cd9d4665-daa0-4ca8-9397-a9949228d103 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:18.303530 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-48d7bb93-05d5-4326-bd21-4e2a55e71b11 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1366 microversion: 2.1 time: 0.236661 Jul 20 17:52:18.304110 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 184/379] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:18 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:18.308837 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:18.312327 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:18.312476 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cd9d4665-daa0-4ca8-9397-a9949228d103 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1515 microversion: 2.1 time: 0.224440 Jul 20 17:52:18.312864 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 196/380] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:18 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:18.320036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:18.320036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:18.320036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:18.320036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:18.457873 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:18.465831 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:18.467892 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:18.469086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9667fbd9-0d6d-4461-8c67-abcf1073f59d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.163824 Jul 20 17:52:18.472478 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 185/381] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:18 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:19.082842 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cf5a6b12-34d7-4232-8a18-5ecaf371d198 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:19.083642 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cf5a6b12-34d7-4232-8a18-5ecaf371d198 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:19.090230 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cf5a6b12-34d7-4232-8a18-5ecaf371d198 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:19.090681 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cf5a6b12-34d7-4232-8a18-5ecaf371d198 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:19.091462 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cf5a6b12-34d7-4232-8a18-5ecaf371d198 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:19.091901 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cf5a6b12-34d7-4232-8a18-5ecaf371d198 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:19.225552 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cf5a6b12-34d7-4232-8a18-5ecaf371d198 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:19.233074 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cf5a6b12-34d7-4232-8a18-5ecaf371d198 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.154700 Jul 20 17:52:19.233658 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 197/382] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:19 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:19.320361 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1e77a89b-5fc7-4dcb-b88d-389e8be4690f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:19.321020 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1e77a89b-5fc7-4dcb-b88d-389e8be4690f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:19.328266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e77a89b-5fc7-4dcb-b88d-389e8be4690f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:19.328858 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e77a89b-5fc7-4dcb-b88d-389e8be4690f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:19.329616 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e77a89b-5fc7-4dcb-b88d-389e8be4690f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:19.330048 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1e77a89b-5fc7-4dcb-b88d-389e8be4690f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:19.461779 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1e77a89b-5fc7-4dcb-b88d-389e8be4690f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:19.469992 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1e77a89b-5fc7-4dcb-b88d-389e8be4690f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1556 microversion: 2.1 time: 0.153459 Jul 20 17:52:19.470563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 186/383] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:19 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:19.490696 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ecaedecd-c524-4792-97c1-d89537533f2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:19.490889 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:19.491001 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ecaedecd-c524-4792-97c1-d89537533f2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:19.491103 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:19.492576 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:19.492695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ecaedecd-c524-4792-97c1-d89537533f2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:19.493029 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:19.493132 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ecaedecd-c524-4792-97c1-d89537533f2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:19.493787 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:19.493894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ecaedecd-c524-4792-97c1-d89537533f2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:19.494223 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:19.494352 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ecaedecd-c524-4792-97c1-d89537533f2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:19.605767 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ecaedecd-c524-4792-97c1-d89537533f2d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123588 Jul 20 17:52:19.606430 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 187/384] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jul 20 17:52:19 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:52:19.666045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:19.674236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:19.675817 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:19.677657 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-82116286-deb9-4d0e-bbf3-c9181f357e99 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.195549 Jul 20 17:52:19.678215 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 198/385] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:19 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:20.000197 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-912db5f8-8b42-4aac-8a22-b1c8eb648750 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:20.003028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-912db5f8-8b42-4aac-8a22-b1c8eb648750 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:20.009478 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-912db5f8-8b42-4aac-8a22-b1c8eb648750 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:20.010160 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-912db5f8-8b42-4aac-8a22-b1c8eb648750 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:20.010942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-912db5f8-8b42-4aac-8a22-b1c8eb648750 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:20.011385 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-912db5f8-8b42-4aac-8a22-b1c8eb648750 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:20.037593 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-912db5f8-8b42-4aac-8a22-b1c8eb648750 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'flavor' on Instance uuid 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:52:20.251174 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5a15ffcc-d2ff-4cc2-b2c2-35ce494b0cb3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:20.251812 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5a15ffcc-d2ff-4cc2-b2c2-35ce494b0cb3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:20.259132 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5a15ffcc-d2ff-4cc2-b2c2-35ce494b0cb3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:20.259599 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5a15ffcc-d2ff-4cc2-b2c2-35ce494b0cb3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:20.260404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5a15ffcc-d2ff-4cc2-b2c2-35ce494b0cb3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:20.261397 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5a15ffcc-d2ff-4cc2-b2c2-35ce494b0cb3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:20.375717 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-912db5f8-8b42-4aac-8a22-b1c8eb648750 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae/action" status: 200 len: 32 microversion: 2.1 time: 0.379900 Jul 20 17:52:20.376671 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 188/386] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:52:19 2022] POST /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae/action => generated 32 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 17:52:20.386024 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e5586a51-f056-4d5a-ae04-6f6aa4397d0e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:20.386726 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e5586a51-f056-4d5a-ae04-6f6aa4397d0e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:20.394257 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5586a51-f056-4d5a-ae04-6f6aa4397d0e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:20.394706 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5586a51-f056-4d5a-ae04-6f6aa4397d0e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:20.395678 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5586a51-f056-4d5a-ae04-6f6aa4397d0e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:20.396271 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e5586a51-f056-4d5a-ae04-6f6aa4397d0e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:20.412217 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5a15ffcc-d2ff-4cc2-b2c2-35ce494b0cb3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:20.422250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5a15ffcc-d2ff-4cc2-b2c2-35ce494b0cb3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.176199 Jul 20 17:52:20.422963 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 199/387] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:20 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:20.532114 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e5586a51-f056-4d5a-ae04-6f6aa4397d0e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:20.539663 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e5586a51-f056-4d5a-ae04-6f6aa4397d0e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.157832 Jul 20 17:52:20.540330 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 189/388] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:20 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:20.696823 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:20.697431 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:20.703962 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:20.704413 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:20.705194 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:20.705627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:20.847171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:20.856999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:20.858791 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:20.859953 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-34aff178-43da-4c6a-b1f8-4236f0725724 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1722 microversion: 2.20 time: 0.167016 Jul 20 17:52:20.860790 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 200/389] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:20 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:21.084313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-5ddcd22b-88e7-4bfd-9b81-459f7b82440b req-aafa428e-f747-40c1-b00d-7b46d7e02466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a959b594-9ce2-4fb1-b648-4016dfecb1b1", "tag": "ea69bd29-73fa-4c45-8d4a-013f8382d993"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:21.093935 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-5ddcd22b-88e7-4bfd-9b81-459f7b82440b req-aafa428e-f747-40c1-b00d-7b46d7e02466 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:21.094847 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-5ddcd22b-88e7-4bfd-9b81-459f7b82440b req-aafa428e-f747-40c1-b00d-7b46d7e02466 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:21.117563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-5ddcd22b-88e7-4bfd-9b81-459f7b82440b req-aafa428e-f747-40c1-b00d-7b46d7e02466 service nova] Creating event network-changed:ea69bd29-73fa-4c45-8d4a-013f8382d993 for instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 on hv-cinder-84984 Jul 20 17:52:21.118747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-5ddcd22b-88e7-4bfd-9b81-459f7b82440b req-aafa428e-f747-40c1-b00d-7b46d7e02466 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038471 Jul 20 17:52:21.119494 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 190/390] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:52:21.331642 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b4641f4d-2717-461e-a8ce-452384fd4e1d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c09f626-5113-49f8-9292-3d1822483da7", "device": "/dev/sdb"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:21.337608 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b4641f4d-2717-461e-a8ce-452384fd4e1d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:21.344720 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b4641f4d-2717-461e-a8ce-452384fd4e1d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:21.345545 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b4641f4d-2717-461e-a8ce-452384fd4e1d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:21.346584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b4641f4d-2717-461e-a8ce-452384fd4e1d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:21.347450 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b4641f4d-2717-461e-a8ce-452384fd4e1d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:21.440848 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d6dedded-0f31-49dc-bed0-96bac37e699f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:21.443383 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d6dedded-0f31-49dc-bed0-96bac37e699f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:21.452659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d6dedded-0f31-49dc-bed0-96bac37e699f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:21.453113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d6dedded-0f31-49dc-bed0-96bac37e699f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:21.453942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d6dedded-0f31-49dc-bed0-96bac37e699f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:21.456672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d6dedded-0f31-49dc-bed0-96bac37e699f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:21.818086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d6dedded-0f31-49dc-bed0-96bac37e699f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:21.826455 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d6dedded-0f31-49dc-bed0-96bac37e699f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.389580 Jul 20 17:52:21.838685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 191/391] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:21 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:21.845747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-08ee0d8d-ff2c-4815-ac83-095e724ba2ad tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:21.847029 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-08ee0d8d-ff2c-4815-ac83-095e724ba2ad tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:21.855531 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08ee0d8d-ff2c-4815-ac83-095e724ba2ad tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:21.856698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08ee0d8d-ff2c-4815-ac83-095e724ba2ad tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:21.858452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08ee0d8d-ff2c-4815-ac83-095e724ba2ad tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:21.859109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08ee0d8d-ff2c-4815-ac83-095e724ba2ad tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:22.267401 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-08ee0d8d-ff2c-4815-ac83-095e724ba2ad tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:22.275267 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-08ee0d8d-ff2c-4815-ac83-095e724ba2ad tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.435020 Jul 20 17:52:22.286192 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 192/392] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:21 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:22.286956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:22.288087 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:22.295848 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:22.296528 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:22.297533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:22.298172 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:22.580100 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:22.597746 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:22.601932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:22.605824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-466bfeac-b997-45bc-9b24-e3338ec780ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1725 microversion: 2.20 time: 0.323530 Jul 20 17:52:22.606628 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 193/393] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:22 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:22.623855 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9f674342-fb72-447c-9682-273fe97bbe26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb42ae2f-9c3b-4147-bbee-769020f31a5f"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:22.624994 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9f674342-fb72-447c-9682-273fe97bbe26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:22.630925 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f674342-fb72-447c-9682-273fe97bbe26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:22.631373 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f674342-fb72-447c-9682-273fe97bbe26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:22.632119 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f674342-fb72-447c-9682-273fe97bbe26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:22.632584 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f674342-fb72-447c-9682-273fe97bbe26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:22.644944 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:22.792369 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b4641f4d-2717-461e-a8ce-452384fd4e1d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "POST /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.466139 Jul 20 17:52:22.799442 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 201/394] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:52:21 2022] POST /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78/os-volume_attachments => generated 194 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:52:22.855991 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7909e1bb-fae8-45c2-9792-cc181a22bc85 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:22.856784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7909e1bb-fae8-45c2-9792-cc181a22bc85 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:22.863877 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7909e1bb-fae8-45c2-9792-cc181a22bc85 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:22.864342 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7909e1bb-fae8-45c2-9792-cc181a22bc85 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:22.865221 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7909e1bb-fae8-45c2-9792-cc181a22bc85 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:22.865753 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7909e1bb-fae8-45c2-9792-cc181a22bc85 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:23.012696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7909e1bb-fae8-45c2-9792-cc181a22bc85 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:23.020663 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7909e1bb-fae8-45c2-9792-cc181a22bc85 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.178942 Jul 20 17:52:23.021242 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 202/395] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:22 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:23.292591 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-80893124-8995-4514-9f95-f5ac478cf595 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:23.293202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-80893124-8995-4514-9f95-f5ac478cf595 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:23.299974 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-80893124-8995-4514-9f95-f5ac478cf595 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:23.300422 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-80893124-8995-4514-9f95-f5ac478cf595 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:23.301320 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-80893124-8995-4514-9f95-f5ac478cf595 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:23.301753 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-80893124-8995-4514-9f95-f5ac478cf595 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:23.442296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-80893124-8995-4514-9f95-f5ac478cf595 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:23.449983 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-80893124-8995-4514-9f95-f5ac478cf595 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.161139 Jul 20 17:52:23.450453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 203/396] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:23 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:23.667950 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9f674342-fb72-447c-9682-273fe97bbe26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.047909 Jul 20 17:52:23.669398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 194/397] 10.222.0.42 () {62 vars in 1363 bytes} [Wed Jul 20 17:52:22 2022] POST /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments => generated 188 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:52:23.784274 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fabefa8c-72fc-4d80-8a2a-afb1c16471e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:23.784863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fabefa8c-72fc-4d80-8a2a-afb1c16471e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:23.791327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fabefa8c-72fc-4d80-8a2a-afb1c16471e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:23.791873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fabefa8c-72fc-4d80-8a2a-afb1c16471e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:23.792674 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fabefa8c-72fc-4d80-8a2a-afb1c16471e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:23.793114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fabefa8c-72fc-4d80-8a2a-afb1c16471e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:24.021144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fabefa8c-72fc-4d80-8a2a-afb1c16471e0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/action" status: 202 len: 0 microversion: 2.20 time: 0.241198 Jul 20 17:52:24.025388 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 204/398] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jul 20 17:52:23 2022] POST /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:52:24.031200 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:24.032305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:24.039848 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3ea8e39b-35fc-40b6-928f-80757d4c20e8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:24.039848 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3ea8e39b-35fc-40b6-928f-80757d4c20e8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:24.042681 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:24.043275 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:24.044064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:24.045099 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:24.045678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3ea8e39b-35fc-40b6-928f-80757d4c20e8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:24.046137 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3ea8e39b-35fc-40b6-928f-80757d4c20e8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:24.046910 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3ea8e39b-35fc-40b6-928f-80757d4c20e8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:24.047351 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3ea8e39b-35fc-40b6-928f-80757d4c20e8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:24.264258 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:24.273000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:24.274520 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:24.275723 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e2a8beb1-0882-4a79-b7b6-93f51dc500aa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1751 microversion: 2.20 time: 0.248743 Jul 20 17:52:24.283341 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 195/399] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:24 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1751 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:24.285669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3ea8e39b-35fc-40b6-928f-80757d4c20e8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:24.295367 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3ea8e39b-35fc-40b6-928f-80757d4c20e8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.261261 Jul 20 17:52:24.296651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 205/400] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:24 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:24.466235 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3cf40a52-a55c-4546-b8d9-b001896ec1f1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:24.466879 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3cf40a52-a55c-4546-b8d9-b001896ec1f1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:24.473426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cf40a52-a55c-4546-b8d9-b001896ec1f1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:24.473877 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cf40a52-a55c-4546-b8d9-b001896ec1f1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:24.474635 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cf40a52-a55c-4546-b8d9-b001896ec1f1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:24.475070 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cf40a52-a55c-4546-b8d9-b001896ec1f1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:24.612302 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3cf40a52-a55c-4546-b8d9-b001896ec1f1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:24.614656 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:24.623443 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3cf40a52-a55c-4546-b8d9-b001896ec1f1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.160433 Jul 20 17:52:24.624019 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 196/401] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:24 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:25.293555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:25.294163 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:25.301986 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:25.302605 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:25.304683 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:25.305251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:25.317224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c555f63b-6936-4b30-bb31-cd6f0cb6c439 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:25.318131 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c555f63b-6936-4b30-bb31-cd6f0cb6c439 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:25.325589 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c555f63b-6936-4b30-bb31-cd6f0cb6c439 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:25.326181 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c555f63b-6936-4b30-bb31-cd6f0cb6c439 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:25.327034 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c555f63b-6936-4b30-bb31-cd6f0cb6c439 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:25.327544 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c555f63b-6936-4b30-bb31-cd6f0cb6c439 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:25.813471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:25.819138 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c555f63b-6936-4b30-bb31-cd6f0cb6c439 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:25.822271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:25.823861 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:25.825068 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-219e2be6-5a7c-4aae-ab29-7b98adeb217f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1751 microversion: 2.20 time: 0.535440 Jul 20 17:52:25.827903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c555f63b-6936-4b30-bb31-cd6f0cb6c439 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.519061 Jul 20 17:52:25.828598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 197/402] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:25 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:25.833932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a76df3ad-cf8e-437c-8ecb-e2fea9a2d968 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:25.835105 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a76df3ad-cf8e-437c-8ecb-e2fea9a2d968 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:25.836738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 206/403] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:25 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1751 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:25.843264 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a76df3ad-cf8e-437c-8ecb-e2fea9a2d968 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:25.847598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a76df3ad-cf8e-437c-8ecb-e2fea9a2d968 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:25.847598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a76df3ad-cf8e-437c-8ecb-e2fea9a2d968 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:25.847598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a76df3ad-cf8e-437c-8ecb-e2fea9a2d968 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:26.122914 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a76df3ad-cf8e-437c-8ecb-e2fea9a2d968 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:26.130495 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a76df3ad-cf8e-437c-8ecb-e2fea9a2d968 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.300642 Jul 20 17:52:26.131354 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 198/404] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:25 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:26.844476 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:26.845105 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:26.852686 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-dcbbdacb-5511-4ccf-bc15-d8c89c7164c2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:26.853371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-dcbbdacb-5511-4ccf-bc15-d8c89c7164c2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:26.853607 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:26.854055 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:26.854811 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:26.855400 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:26.859815 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dcbbdacb-5511-4ccf-bc15-d8c89c7164c2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:26.860589 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dcbbdacb-5511-4ccf-bc15-d8c89c7164c2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:26.861364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dcbbdacb-5511-4ccf-bc15-d8c89c7164c2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:26.861800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dcbbdacb-5511-4ccf-bc15-d8c89c7164c2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:27.060864 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:27.065822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-dcbbdacb-5511-4ccf-bc15-d8c89c7164c2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:27.070181 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:27.078780 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:27.078780 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1b179e8d-fc12-46a0-a098-cc1322d8f3ca tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.233864 Jul 20 17:52:27.078780 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 207/405] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:26 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:27.079104 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-dcbbdacb-5511-4ccf-bc15-d8c89c7164c2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.224992 Jul 20 17:52:27.079104 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 199/406] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:26 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:27.148812 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e8dcec5b-3ace-4ad0-9649-4d04d3989970 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:27.149409 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e8dcec5b-3ace-4ad0-9649-4d04d3989970 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:27.155878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e8dcec5b-3ace-4ad0-9649-4d04d3989970 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:27.156319 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e8dcec5b-3ace-4ad0-9649-4d04d3989970 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:27.157175 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e8dcec5b-3ace-4ad0-9649-4d04d3989970 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:27.157523 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e8dcec5b-3ace-4ad0-9649-4d04d3989970 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:27.290065 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e8dcec5b-3ace-4ad0-9649-4d04d3989970 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:27.298725 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e8dcec5b-3ace-4ad0-9649-4d04d3989970 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.153945 Jul 20 17:52:27.299311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 208/407] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:27 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:28.091903 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:28.103991 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:28.105542 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-73e14ab3-1fa4-4685-916b-5c82e9d40ae2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:28.107311 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-73e14ab3-1fa4-4685-916b-5c82e9d40ae2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:28.114836 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73e14ab3-1fa4-4685-916b-5c82e9d40ae2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:28.115323 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73e14ab3-1fa4-4685-916b-5c82e9d40ae2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:28.116104 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73e14ab3-1fa4-4685-916b-5c82e9d40ae2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:28.116777 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73e14ab3-1fa4-4685-916b-5c82e9d40ae2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:28.117585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:28.118036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:28.126690 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:28.127331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:28.327677 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-73e14ab3-1fa4-4685-916b-5c82e9d40ae2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:28.331677 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:28.339255 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-73e14ab3-1fa4-4685-916b-5c82e9d40ae2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.251391 Jul 20 17:52:28.340065 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 200/408] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:28 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:28.342938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:28.344422 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:28.345594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-8a42dee5-e230-4cc4-b164-b9fbf9adf896 req-90f466d0-9810-4606-9919-8264c7d877ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3192a390-865f-408d-adb6-01f03593249c", "name": "network-vif-plugged", "status": "completed", "tag": "05bc7328-58f7-4b9a-89df-2347f267ebb3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:28.345936 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7dd597ce-260a-458f-96f9-7920697dac9d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.257897 Jul 20 17:52:28.346383 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 209/409] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:28 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:28.353010 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-76bdc8a2-2c06-46be-9582-383b77cb8e51 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:28.353717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-76bdc8a2-2c06-46be-9582-383b77cb8e51 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:28.354162 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8a42dee5-e230-4cc4-b164-b9fbf9adf896 req-90f466d0-9810-4606-9919-8264c7d877ee service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:28.354613 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8a42dee5-e230-4cc4-b164-b9fbf9adf896 req-90f466d0-9810-4606-9919-8264c7d877ee service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:28.360566 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-76bdc8a2-2c06-46be-9582-383b77cb8e51 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:28.361094 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-76bdc8a2-2c06-46be-9582-383b77cb8e51 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:28.361918 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-76bdc8a2-2c06-46be-9582-383b77cb8e51 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:28.362424 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-76bdc8a2-2c06-46be-9582-383b77cb8e51 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:28.366805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-8a42dee5-e230-4cc4-b164-b9fbf9adf896 req-90f466d0-9810-4606-9919-8264c7d877ee service nova] Creating event network-vif-plugged:05bc7328-58f7-4b9a-89df-2347f267ebb3 for instance 3192a390-865f-408d-adb6-01f03593249c on hv-cinder-84984 Jul 20 17:52:28.372515 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-8a42dee5-e230-4cc4-b164-b9fbf9adf896 req-90f466d0-9810-4606-9919-8264c7d877ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030594 Jul 20 17:52:28.373155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 201/410] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:52:28.491733 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-76bdc8a2-2c06-46be-9582-383b77cb8e51 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:28.499652 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-76bdc8a2-2c06-46be-9582-383b77cb8e51 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.152125 Jul 20 17:52:28.500226 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 210/411] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:28 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:29.357394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4ffbf19b-254b-4f36-9bda-278c2d0c6ef4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:29.358005 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4ffbf19b-254b-4f36-9bda-278c2d0c6ef4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:29.363257 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:29.363868 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:29.365241 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ffbf19b-254b-4f36-9bda-278c2d0c6ef4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:29.365685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ffbf19b-254b-4f36-9bda-278c2d0c6ef4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:29.366441 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ffbf19b-254b-4f36-9bda-278c2d0c6ef4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:29.366876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ffbf19b-254b-4f36-9bda-278c2d0c6ef4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:29.369999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:29.370453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:29.371207 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:29.371640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:29.564939 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4ffbf19b-254b-4f36-9bda-278c2d0c6ef4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:29.568490 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:29.573551 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4ffbf19b-254b-4f36-9bda-278c2d0c6ef4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1358 microversion: 2.1 time: 0.220676 Jul 20 17:52:29.574128 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 202/412] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:29 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:29.577404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:29.578893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:29.579156 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-291f846f-62ee-402f-91e6-e92c72fa6557 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:29.579756 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-291f846f-62ee-402f-91e6-e92c72fa6557 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:29.580047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-eee7aebe-db55-4b2d-9f7b-a3ec3a028b53 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.220614 Jul 20 17:52:29.584574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 211/413] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:29 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:29.585677 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-291f846f-62ee-402f-91e6-e92c72fa6557 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:29.586125 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-291f846f-62ee-402f-91e6-e92c72fa6557 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:29.586887 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-291f846f-62ee-402f-91e6-e92c72fa6557 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:29.587335 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-291f846f-62ee-402f-91e6-e92c72fa6557 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:29.730084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-291f846f-62ee-402f-91e6-e92c72fa6557 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:29.737596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-291f846f-62ee-402f-91e6-e92c72fa6557 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.162509 Jul 20 17:52:29.741645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 203/414] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:29 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:30.591361 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7530223f-527d-4cc5-a9c6-69c818360b29 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:30.591978 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7530223f-527d-4cc5-a9c6-69c818360b29 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:30.597382 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:30.598193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:30.598527 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7530223f-527d-4cc5-a9c6-69c818360b29 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:30.598977 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7530223f-527d-4cc5-a9c6-69c818360b29 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:30.599747 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7530223f-527d-4cc5-a9c6-69c818360b29 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:30.600252 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7530223f-527d-4cc5-a9c6-69c818360b29 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:30.605611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:30.606064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:30.606836 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:30.607767 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:30.803221 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:30.807728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7530223f-527d-4cc5-a9c6-69c818360b29 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:30.812990 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:30.814504 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:30.815699 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-231ac12d-ef3c-46ea-9846-84b2f93872c3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.222158 Jul 20 17:52:30.816263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 204/415] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:30 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:30.816375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7530223f-527d-4cc5-a9c6-69c818360b29 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1548 microversion: 2.1 time: 0.229078 Jul 20 17:52:30.820641 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-56da35f0-99a4-4f12-92b1-d088e69f0915 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:30.821145 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 212/416] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:30 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1548 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:30.821259 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-56da35f0-99a4-4f12-92b1-d088e69f0915 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:30.827086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-56da35f0-99a4-4f12-92b1-d088e69f0915 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:30.827561 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-56da35f0-99a4-4f12-92b1-d088e69f0915 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:30.828346 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-56da35f0-99a4-4f12-92b1-d088e69f0915 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:30.828813 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-56da35f0-99a4-4f12-92b1-d088e69f0915 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:30.838640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8f1f640f-2ca1-4671-a2dc-b0e782b84479 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:30.839282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8f1f640f-2ca1-4671-a2dc-b0e782b84479 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:30.846034 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8f1f640f-2ca1-4671-a2dc-b0e782b84479 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:30.846396 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8f1f640f-2ca1-4671-a2dc-b0e782b84479 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:30.847465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8f1f640f-2ca1-4671-a2dc-b0e782b84479 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:30.848059 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8f1f640f-2ca1-4671-a2dc-b0e782b84479 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:31.046266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-56da35f0-99a4-4f12-92b1-d088e69f0915 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:31.053683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-56da35f0-99a4-4f12-92b1-d088e69f0915 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.236443 Jul 20 17:52:31.054265 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 205/417] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:30 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:31.057474 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8f1f640f-2ca1-4671-a2dc-b0e782b84479 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:31.065164 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8f1f640f-2ca1-4671-a2dc-b0e782b84479 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1548 microversion: 2.1 time: 0.230595 Jul 20 17:52:31.065718 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 213/418] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:30 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:31.080308 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8816e200-2384-4245-8b4c-d0f4524f727e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:31.083905 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8816e200-2384-4245-8b4c-d0f4524f727e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:31.084732 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8816e200-2384-4245-8b4c-d0f4524f727e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Searching by: {'deleted': False, 'project_id': '63d0c5b02155444fb44a732c46674b8f'} {{(pid=124845) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 17:52:31.091796 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8816e200-2384-4245-8b4c-d0f4524f727e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:31.092250 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8816e200-2384-4245-8b4c-d0f4524f727e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:31.093090 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8816e200-2384-4245-8b4c-d0f4524f727e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:31.093533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8816e200-2384-4245-8b4c-d0f4524f727e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:31.190148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.multi_cell_list [None req-8816e200-2384-4245-8b4c-d0f4524f727e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124845) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 17:52:31.283509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8816e200-2384-4245-8b4c-d0f4524f727e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206571 Jul 20 17:52:31.284360 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 206/419] 10.222.0.42 () {58 vars in 1124 bytes} [Wed Jul 20 17:52:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:52:31.298507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-695558da-d274-4176-9cdc-68ffeaf8f2e4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:31.301600 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-695558da-d274-4176-9cdc-68ffeaf8f2e4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:31.307723 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-695558da-d274-4176-9cdc-68ffeaf8f2e4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:31.308176 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-695558da-d274-4176-9cdc-68ffeaf8f2e4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:31.309097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-695558da-d274-4176-9cdc-68ffeaf8f2e4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:31.309749 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-695558da-d274-4176-9cdc-68ffeaf8f2e4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:31.457699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-695558da-d274-4176-9cdc-68ffeaf8f2e4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:31.470795 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-695558da-d274-4176-9cdc-68ffeaf8f2e4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1548 microversion: 2.1 time: 0.178536 Jul 20 17:52:31.475872 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 214/420] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:31 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:31.833957 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:31.834573 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:31.841015 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:31.841977 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:31.842737 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:31.843170 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:31.981379 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:31.990815 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:31.992353 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:31.993534 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2c0e6029-9be0-4173-aa6d-0ce47e60fafe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.163563 Jul 20 17:52:31.994091 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 207/421] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:31 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:32.077276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c98d2560-bf58-437d-a67a-c801561146a6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:32.077276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c98d2560-bf58-437d-a67a-c801561146a6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:32.078765 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c98d2560-bf58-437d-a67a-c801561146a6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:32.079485 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c98d2560-bf58-437d-a67a-c801561146a6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:32.080265 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c98d2560-bf58-437d-a67a-c801561146a6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:32.080727 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c98d2560-bf58-437d-a67a-c801561146a6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:32.236819 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c98d2560-bf58-437d-a67a-c801561146a6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:32.246608 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c98d2560-bf58-437d-a67a-c801561146a6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.179733 Jul 20 17:52:32.247415 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 215/422] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:32 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:33.011190 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:33.011917 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:33.019076 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:33.019525 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:33.020337 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:33.020803 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:33.180347 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:33.202344 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:33.208540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:33.208540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-93c9801a-65bd-4f2b-982b-6317b692984d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.198001 Jul 20 17:52:33.208540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 208/423] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:33 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:33.263069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ea24d226-7b58-4292-abaf-caef76cdc4f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:33.263612 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ea24d226-7b58-4292-abaf-caef76cdc4f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:33.266063 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=98 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:33.270890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ea24d226-7b58-4292-abaf-caef76cdc4f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:33.271341 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ea24d226-7b58-4292-abaf-caef76cdc4f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:33.272101 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ea24d226-7b58-4292-abaf-caef76cdc4f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:33.272572 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ea24d226-7b58-4292-abaf-caef76cdc4f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:33.395050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1b7bd60a-8a2f-4e2c-9904-d5c1b4b1b4e7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fcb3e4a-3cfd-4302-97b9-2b760088fbc4"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:52:33.396201 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1b7bd60a-8a2f-4e2c-9904-d5c1b4b1b4e7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:33.402469 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b7bd60a-8a2f-4e2c-9904-d5c1b4b1b4e7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:33.402914 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b7bd60a-8a2f-4e2c-9904-d5c1b4b1b4e7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:33.404201 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b7bd60a-8a2f-4e2c-9904-d5c1b4b1b4e7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:33.404774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1b7bd60a-8a2f-4e2c-9904-d5c1b4b1b4e7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:33.415615 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ea24d226-7b58-4292-abaf-caef76cdc4f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:33.420640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:33.424904 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ea24d226-7b58-4292-abaf-caef76cdc4f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.165673 Jul 20 17:52:33.426317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 216/424] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:33 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:34.225818 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:34.226428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:34.233649 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:34.234101 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:34.234858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:34.235295 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:34.371676 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:34.380175 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:34.381705 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:34.382905 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8ddcdad4-c7af-4733-a0e7-d3f06bfb8aeb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.161036 Jul 20 17:52:34.383419 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 217/425] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:34 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:34.442661 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0ff1a1b6-d141-4b6c-a7bb-81ecd9c85c5b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:34.443269 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0ff1a1b6-d141-4b6c-a7bb-81ecd9c85c5b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:34.449675 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0ff1a1b6-d141-4b6c-a7bb-81ecd9c85c5b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:34.450120 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0ff1a1b6-d141-4b6c-a7bb-81ecd9c85c5b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:34.451406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0ff1a1b6-d141-4b6c-a7bb-81ecd9c85c5b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:34.451841 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0ff1a1b6-d141-4b6c-a7bb-81ecd9c85c5b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:34.494689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1b7bd60a-8a2f-4e2c-9904-d5c1b4b1b4e7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "POST /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.103623 Jul 20 17:52:34.495586 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 209/426] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:52:33 2022] POST /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments => generated 194 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:52:34.592706 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0ff1a1b6-d141-4b6c-a7bb-81ecd9c85c5b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:34.600189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0ff1a1b6-d141-4b6c-a7bb-81ecd9c85c5b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.161315 Jul 20 17:52:34.600730 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 218/427] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:34 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:35.402963 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:35.403569 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:35.410672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:35.411118 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:35.411878 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:35.412302 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:35.539214 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:35.547475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:35.549027 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:35.550163 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8a125f6e-bf90-4f1b-9dac-075c06bc8291 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.152179 Jul 20 17:52:35.550716 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 210/428] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:35 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:35.616883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a46dc78a-acd3-497d-90b4-682e61ef6800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:35.617494 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a46dc78a-acd3-497d-90b4-682e61ef6800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:35.624290 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a46dc78a-acd3-497d-90b4-682e61ef6800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:35.624767 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a46dc78a-acd3-497d-90b4-682e61ef6800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:35.625519 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a46dc78a-acd3-497d-90b4-682e61ef6800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:35.625953 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a46dc78a-acd3-497d-90b4-682e61ef6800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:35.758056 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a46dc78a-acd3-497d-90b4-682e61ef6800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:35.766021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a46dc78a-acd3-497d-90b4-682e61ef6800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.152894 Jul 20 17:52:35.766600 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 219/429] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:35 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:36.568658 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:36.569267 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:36.576317 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:36.576790 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:36.577550 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:36.578006 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:36.709879 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:36.718884 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:36.720368 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:36.721535 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a32a1903-b3d3-40ee-98c1-a2e7de9854b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.156782 Jul 20 17:52:36.722093 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 211/430] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:36 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:36.783735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2ad3f2e3-7a8e-4081-b6f4-39ed3d7c2bae tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:36.784353 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2ad3f2e3-7a8e-4081-b6f4-39ed3d7c2bae tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:36.790768 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ad3f2e3-7a8e-4081-b6f4-39ed3d7c2bae tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:36.791219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ad3f2e3-7a8e-4081-b6f4-39ed3d7c2bae tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:36.791980 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ad3f2e3-7a8e-4081-b6f4-39ed3d7c2bae tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:36.792420 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ad3f2e3-7a8e-4081-b6f4-39ed3d7c2bae tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:36.918086 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2ad3f2e3-7a8e-4081-b6f4-39ed3d7c2bae tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:36.925743 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2ad3f2e3-7a8e-4081-b6f4-39ed3d7c2bae tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.145818 Jul 20 17:52:36.926340 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 220/431] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:36 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:37.739207 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:37.739802 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:37.746703 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:37.747153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:37.747938 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:37.748420 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:37.764257 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:37.883891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:37.892648 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:37.894164 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:37.895462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-34d9c047-81f0-4d75-bdbe-b36a8f2ecaff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1753 microversion: 2.20 time: 0.159987 Jul 20 17:52:37.897439 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 212/432] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:37 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:37.943400 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e78e83bd-ebc7-4751-baed-d31aa10c50c2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:37.944046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e78e83bd-ebc7-4751-baed-d31aa10c50c2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:37.950687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e78e83bd-ebc7-4751-baed-d31aa10c50c2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:37.954793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e78e83bd-ebc7-4751-baed-d31aa10c50c2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:37.954793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e78e83bd-ebc7-4751-baed-d31aa10c50c2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:37.954793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e78e83bd-ebc7-4751-baed-d31aa10c50c2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:38.083003 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e78e83bd-ebc7-4751-baed-d31aa10c50c2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:38.090724 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e78e83bd-ebc7-4751-baed-d31aa10c50c2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.151325 Jul 20 17:52:38.091347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 221/433] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:37 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:38.913496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:38.917958 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:38.921308 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:38.921628 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:38.922562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:38.923114 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:39.108545 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-db7ff5f6-721b-42ca-9499-30819649b2d6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:39.109614 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-db7ff5f6-721b-42ca-9499-30819649b2d6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:39.116242 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-db7ff5f6-721b-42ca-9499-30819649b2d6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:39.116729 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-db7ff5f6-721b-42ca-9499-30819649b2d6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:39.117486 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-db7ff5f6-721b-42ca-9499-30819649b2d6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:39.117916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-db7ff5f6-721b-42ca-9499-30819649b2d6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:39.153256 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:39.162749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:39.164304 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:39.165426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a45bc26e-d686-4919-83eb-7e99b08103c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.256299 Jul 20 17:52:39.165987 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 213/434] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:38 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:39.337566 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-db7ff5f6-721b-42ca-9499-30819649b2d6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:39.345000 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-db7ff5f6-721b-42ca-9499-30819649b2d6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.241698 Jul 20 17:52:39.346180 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 222/435] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:39 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:40.183542 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:40.184204 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:40.186836 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=92 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:40.191509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:40.191945 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:40.192738 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:40.193167 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:40.319845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:40.328777 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:40.330283 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:40.331432 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0586a604-9ce1-4db0-9131-8b48f55068c8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.152260 Jul 20 17:52:40.332204 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 214/436] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:40 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:40.361824 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8c02ecf0-9a28-4937-8b4d-43a592f794a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:40.362368 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8c02ecf0-9a28-4937-8b4d-43a592f794a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:40.369037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c02ecf0-9a28-4937-8b4d-43a592f794a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:40.369497 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c02ecf0-9a28-4937-8b4d-43a592f794a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:40.370262 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c02ecf0-9a28-4937-8b4d-43a592f794a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:40.370702 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c02ecf0-9a28-4937-8b4d-43a592f794a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:40.499033 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8c02ecf0-9a28-4937-8b4d-43a592f794a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:40.506652 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8c02ecf0-9a28-4937-8b4d-43a592f794a8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.148680 Jul 20 17:52:40.507216 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 223/437] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:40 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:41.350903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:41.351438 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:41.353306 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:41.359198 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:41.359639 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:41.360399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:41.360855 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:41.494913 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:41.506151 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:41.507676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:41.508845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f3df5d23-ca90-412a-8da1-ed7c9691abff tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.162392 Jul 20 17:52:41.509397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 215/438] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:41 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:41.523009 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3139605d-4b43-4e67-9b1e-c1873838ed0c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:41.523791 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3139605d-4b43-4e67-9b1e-c1873838ed0c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:41.530623 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3139605d-4b43-4e67-9b1e-c1873838ed0c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:41.531065 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3139605d-4b43-4e67-9b1e-c1873838ed0c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:41.531809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3139605d-4b43-4e67-9b1e-c1873838ed0c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:41.532237 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3139605d-4b43-4e67-9b1e-c1873838ed0c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:41.660899 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3139605d-4b43-4e67-9b1e-c1873838ed0c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:41.668457 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3139605d-4b43-4e67-9b1e-c1873838ed0c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.149277 Jul 20 17:52:41.669043 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 224/439] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:41 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:42.527139 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:42.527740 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:42.534215 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:42.534660 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:42.535853 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:42.535967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:42.662256 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:42.671144 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:42.672668 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:42.682426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-063a562c-5cbb-4f04-85e0-401a9a9eaadb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.150687 Jul 20 17:52:42.682426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 216/440] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:42 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:42.686158 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a1e25c8e-9afd-45cb-acf2-0989a8773fe6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:42.687069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a1e25c8e-9afd-45cb-acf2-0989a8773fe6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:42.694432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a1e25c8e-9afd-45cb-acf2-0989a8773fe6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:42.694881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a1e25c8e-9afd-45cb-acf2-0989a8773fe6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:42.695636 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a1e25c8e-9afd-45cb-acf2-0989a8773fe6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:42.696112 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a1e25c8e-9afd-45cb-acf2-0989a8773fe6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:42.823477 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a1e25c8e-9afd-45cb-acf2-0989a8773fe6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:42.831306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a1e25c8e-9afd-45cb-acf2-0989a8773fe6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.148989 Jul 20 17:52:42.831882 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 225/441] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:42 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:43.692368 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:43.693004 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:43.699558 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:43.700005 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:43.701404 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:43.701843 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:43.835469 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:43.844016 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:43.849907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:43.849907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-32d2f9fe-0007-4869-9f41-ff559b05e558 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.158398 Jul 20 17:52:43.849907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 217/442] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:43 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:43.850162 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-52149f83-9e7b-43f1-8cd8-cbe3e76c7c1f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:43.850162 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-52149f83-9e7b-43f1-8cd8-cbe3e76c7c1f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:43.855506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52149f83-9e7b-43f1-8cd8-cbe3e76c7c1f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:43.856013 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52149f83-9e7b-43f1-8cd8-cbe3e76c7c1f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:43.856829 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52149f83-9e7b-43f1-8cd8-cbe3e76c7c1f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:43.857268 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52149f83-9e7b-43f1-8cd8-cbe3e76c7c1f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:43.983965 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-52149f83-9e7b-43f1-8cd8-cbe3e76c7c1f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:43.991509 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-52149f83-9e7b-43f1-8cd8-cbe3e76c7c1f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.147247 Jul 20 17:52:43.992089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 226/443] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:43 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:44.866190 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:44.866764 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:44.874133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:44.881289 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:44.881289 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:44.881289 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:45.008967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-57a4d90e-89aa-41d0-8788-1ea28bfd55d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:45.009448 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:45.009593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-57a4d90e-89aa-41d0-8788-1ea28bfd55d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:45.016483 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-57a4d90e-89aa-41d0-8788-1ea28bfd55d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:45.016939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-57a4d90e-89aa-41d0-8788-1ea28bfd55d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:45.017709 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-57a4d90e-89aa-41d0-8788-1ea28bfd55d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:45.017824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:45.018148 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-57a4d90e-89aa-41d0-8788-1ea28bfd55d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:45.019274 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:45.020418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fe081b90-4e6a-42e1-9a7e-57f30d45c711 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.158445 Jul 20 17:52:45.020999 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 218/444] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:44 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:45.165841 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-57a4d90e-89aa-41d0-8788-1ea28bfd55d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:45.173303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-57a4d90e-89aa-41d0-8788-1ea28bfd55d8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.168297 Jul 20 17:52:45.173854 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 227/445] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:45 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:46.038375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:46.039018 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:46.045478 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:46.045903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:46.046656 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:46.047090 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:46.184636 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:46.190683 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e3d0d8a9-b1d6-4ab9-8097-9a15a7d68e44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:46.191337 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e3d0d8a9-b1d6-4ab9-8097-9a15a7d68e44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:46.194229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:46.195740 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:46.196929 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c73fc493-4b54-4b6f-a5d8-937d2a59c79a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.162464 Jul 20 17:52:46.197975 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 219/446] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:46 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:46.198668 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e3d0d8a9-b1d6-4ab9-8097-9a15a7d68e44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:46.199179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e3d0d8a9-b1d6-4ab9-8097-9a15a7d68e44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:46.200181 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e3d0d8a9-b1d6-4ab9-8097-9a15a7d68e44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:46.200749 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e3d0d8a9-b1d6-4ab9-8097-9a15a7d68e44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:46.330486 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e3d0d8a9-b1d6-4ab9-8097-9a15a7d68e44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:46.337810 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e3d0d8a9-b1d6-4ab9-8097-9a15a7d68e44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.151308 Jul 20 17:52:46.338370 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 228/447] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:46 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:47.215030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:47.215719 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:47.222609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:47.223004 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:47.223776 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:47.224213 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:47.354936 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6c24103a-5c35-4d33-aded-7ec01a18a2c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:47.355443 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6c24103a-5c35-4d33-aded-7ec01a18a2c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:47.362693 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c24103a-5c35-4d33-aded-7ec01a18a2c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:47.363147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c24103a-5c35-4d33-aded-7ec01a18a2c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:47.363919 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c24103a-5c35-4d33-aded-7ec01a18a2c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:47.364357 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c24103a-5c35-4d33-aded-7ec01a18a2c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:47.364513 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:47.372785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:47.374278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:47.375418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-355445b2-3d6f-46bb-b1b5-29e4e2821407 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.164328 Jul 20 17:52:47.375973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 220/448] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:47 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:47.504208 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6c24103a-5c35-4d33-aded-7ec01a18a2c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:47.511767 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6c24103a-5c35-4d33-aded-7ec01a18a2c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.160865 Jul 20 17:52:47.512330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 229/449] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:47 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:48.393347 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:48.393953 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:48.400414 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:48.400891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:48.401649 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:48.402083 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:48.527004 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:48.529343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0e88d057-5a84-4db2-bb7e-28dcfc4f4708 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:48.530047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0e88d057-5a84-4db2-bb7e-28dcfc4f4708 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:48.536378 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:48.536574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e88d057-5a84-4db2-bb7e-28dcfc4f4708 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:48.537056 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e88d057-5a84-4db2-bb7e-28dcfc4f4708 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:48.537896 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e88d057-5a84-4db2-bb7e-28dcfc4f4708 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:48.537999 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:48.538445 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0e88d057-5a84-4db2-bb7e-28dcfc4f4708 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:48.539045 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-649b9e91-9cde-4384-83d1-d3b30620cba1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.149597 Jul 20 17:52:48.539609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 221/450] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:48 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:48.670171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0e88d057-5a84-4db2-bb7e-28dcfc4f4708 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:48.677593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0e88d057-5a84-4db2-bb7e-28dcfc4f4708 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.152286 Jul 20 17:52:48.678157 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 230/451] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:48 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:52:49.557858 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:49.558553 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:49.566041 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:49.566484 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:49.567245 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:49.567675 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:49.696181 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5aaeed8f-b00d-49a2-acbf-ddf0f553b271 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:49.698307 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5aaeed8f-b00d-49a2-acbf-ddf0f553b271 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:49.708904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:49.717846 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5aaeed8f-b00d-49a2-acbf-ddf0f553b271 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:49.720114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5aaeed8f-b00d-49a2-acbf-ddf0f553b271 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:49.721252 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5aaeed8f-b00d-49a2-acbf-ddf0f553b271 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:49.722495 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:49.724044 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:49.724570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5aaeed8f-b00d-49a2-acbf-ddf0f553b271 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:49.730690 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-46f23aaf-6024-430a-8db4-4e387980eb81 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.176885 Jul 20 17:52:49.731279 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 222/452] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:49 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:49.879626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5aaeed8f-b00d-49a2-acbf-ddf0f553b271 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:49.887454 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5aaeed8f-b00d-49a2-acbf-ddf0f553b271 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.195948 Jul 20 17:52:49.888894 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 231/453] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:49 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:50.749572 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:50.750193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:50.757742 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:50.758431 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:50.759203 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:50.759785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:50.901910 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:50.906189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-54e6d77a-2c8c-45fb-972b-322c4c73ac0f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:50.906862 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-54e6d77a-2c8c-45fb-972b-322c4c73ac0f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:50.912341 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:50.913896 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:50.915062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a23d78fc-87e5-4a54-868c-fd20a68f4b32 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.170051 Jul 20 17:52:50.915612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 223/454] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:50 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:50.930099 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-54e6d77a-2c8c-45fb-972b-322c4c73ac0f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:50.930424 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-54e6d77a-2c8c-45fb-972b-322c4c73ac0f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:50.931186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-54e6d77a-2c8c-45fb-972b-322c4c73ac0f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:50.931867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-54e6d77a-2c8c-45fb-972b-322c4c73ac0f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:51.085887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-54e6d77a-2c8c-45fb-972b-322c4c73ac0f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:51.099226 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-54e6d77a-2c8c-45fb-972b-322c4c73ac0f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.197361 Jul 20 17:52:51.099817 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 232/455] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:50 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:51.934309 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:51.935490 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:51.942424 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:51.942876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:51.943646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:51.944164 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:52.084695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:52.098205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:52.098205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:52.100336 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9762e209-6f53-4beb-87bb-8e4408147aa5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.167872 Jul 20 17:52:52.101606 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 224/456] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:51 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:52.115805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-17cd12cf-08dd-4438-8a13-c0628b1e0e30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:52.116990 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-17cd12cf-08dd-4438-8a13-c0628b1e0e30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:52.124891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-17cd12cf-08dd-4438-8a13-c0628b1e0e30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:52.128476 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-17cd12cf-08dd-4438-8a13-c0628b1e0e30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:52.128476 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-17cd12cf-08dd-4438-8a13-c0628b1e0e30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:52.128476 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-17cd12cf-08dd-4438-8a13-c0628b1e0e30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:52.145962 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=100 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:52.270564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-17cd12cf-08dd-4438-8a13-c0628b1e0e30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:52.281604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-17cd12cf-08dd-4438-8a13-c0628b1e0e30 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.169760 Jul 20 17:52:52.288635 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 233/457] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:52 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:53.119406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:53.120079 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:53.126616 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:53.127059 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:53.127822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:53.128262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:53.269397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:53.278615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:53.280255 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:53.281512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0c58fc8d-7103-4fb7-9047-0f27802884dc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.166103 Jul 20 17:52:53.282102 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 225/458] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:53 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:53.299163 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0a6984aa-7ddb-44e7-a582-2766524435b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:53.300391 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0a6984aa-7ddb-44e7-a582-2766524435b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:53.308905 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a6984aa-7ddb-44e7-a582-2766524435b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:53.310598 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a6984aa-7ddb-44e7-a582-2766524435b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:53.311303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a6984aa-7ddb-44e7-a582-2766524435b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:53.311303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a6984aa-7ddb-44e7-a582-2766524435b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:53.463981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0a6984aa-7ddb-44e7-a582-2766524435b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:53.472072 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0a6984aa-7ddb-44e7-a582-2766524435b9 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.176811 Jul 20 17:52:53.472679 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 234/459] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:53 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:53.902221 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eab6312d-5663-460d-898e-c58843392f8a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:53.902716 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-eab6312d-5663-460d-898e-c58843392f8a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:53.910178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eab6312d-5663-460d-898e-c58843392f8a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:53.910852 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eab6312d-5663-460d-898e-c58843392f8a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:53.911627 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eab6312d-5663-460d-898e-c58843392f8a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:53.912246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eab6312d-5663-460d-898e-c58843392f8a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:54.082391 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-eab6312d-5663-460d-898e-c58843392f8a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lazy-loading 'services' on Instance uuid bd17b0fa-8b69-4617-8534-d173f891cb78 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:52:54.300652 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:54.301341 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:54.307899 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:54.308326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:54.309096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:54.309538 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:54.404411 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-eab6312d-5663-460d-898e-c58843392f8a tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78/os-volume_attachments/3c09f626-5113-49f8-9292-3d1822483da7" status: 202 len: 0 microversion: 2.1 time: 0.505947 Jul 20 17:52:54.405144 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 226/460] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:52:53 2022] DELETE /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78/os-volume_attachments/3c09f626-5113-49f8-9292-3d1822483da7 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:52:54.455298 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:54.471848 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:54.473706 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:54.475189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1f74fc67-c235-4edc-94c0-7f8c170ef7a0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.178529 Jul 20 17:52:54.479324 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 235/461] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:54 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:54.495505 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-08f1c2d0-6c32-43de-a5af-f5de14075456 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:54.496286 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-08f1c2d0-6c32-43de-a5af-f5de14075456 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:54.503133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08f1c2d0-6c32-43de-a5af-f5de14075456 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:54.503583 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08f1c2d0-6c32-43de-a5af-f5de14075456 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:54.504351 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08f1c2d0-6c32-43de-a5af-f5de14075456 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:54.504831 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08f1c2d0-6c32-43de-a5af-f5de14075456 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:54.657744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-08f1c2d0-6c32-43de-a5af-f5de14075456 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:54.665398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-08f1c2d0-6c32-43de-a5af-f5de14075456 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.174251 Jul 20 17:52:54.666178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 227/462] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:54 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:55.501643 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:55.501643 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:55.506572 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:55.507226 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:55.508846 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:55.509479 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:55.660708 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:55.670873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:55.672511 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:55.673863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-28be9181-3479-41ed-9765-3310bf3251f6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.180752 Jul 20 17:52:55.675012 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 236/463] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:55 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:55.682950 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c4f16534-613d-49ac-bdd5-dac8b215dc11 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:55.684885 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c4f16534-613d-49ac-bdd5-dac8b215dc11 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:55.693895 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4f16534-613d-49ac-bdd5-dac8b215dc11 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:55.694339 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4f16534-613d-49ac-bdd5-dac8b215dc11 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:55.695101 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4f16534-613d-49ac-bdd5-dac8b215dc11 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:55.695529 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4f16534-613d-49ac-bdd5-dac8b215dc11 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:55.711221 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:52:55.835107 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c4f16534-613d-49ac-bdd5-dac8b215dc11 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:55.843823 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c4f16534-613d-49ac-bdd5-dac8b215dc11 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.164606 Jul 20 17:52:55.844406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 228/464] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:55 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:56.701897 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:56.705872 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:56.723388 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:56.724860 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:56.726075 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:56.726531 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:56.865406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bd18bdc8-30cf-4f51-a917-b6465678992d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:56.866707 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bd18bdc8-30cf-4f51-a917-b6465678992d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:56.879101 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd18bdc8-30cf-4f51-a917-b6465678992d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:56.887941 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd18bdc8-30cf-4f51-a917-b6465678992d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:56.889773 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd18bdc8-30cf-4f51-a917-b6465678992d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:56.890461 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd18bdc8-30cf-4f51-a917-b6465678992d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:56.899236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:56.909647 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:56.918376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:56.920511 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-30f9dc22-7ec5-406d-8c7e-f1037947e33b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.223318 Jul 20 17:52:56.921062 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 237/465] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:56 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:52:57.076200 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bd18bdc8-30cf-4f51-a917-b6465678992d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:57.083913 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bd18bdc8-30cf-4f51-a917-b6465678992d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.226877 Jul 20 17:52:57.094242 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 229/466] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:56 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:57.940908 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:57.941599 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:57.947713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:57.948288 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:57.949329 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:57.949742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:58.113151 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-af14b3fe-d16f-4e2a-85dd-40c28b7ad264 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:58.113151 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-af14b3fe-d16f-4e2a-85dd-40c28b7ad264 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:58.113151 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-af14b3fe-d16f-4e2a-85dd-40c28b7ad264 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:58.116997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-af14b3fe-d16f-4e2a-85dd-40c28b7ad264 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:58.117830 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-af14b3fe-d16f-4e2a-85dd-40c28b7ad264 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:58.118276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-af14b3fe-d16f-4e2a-85dd-40c28b7ad264 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:58.140209 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:58.157309 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:58.159150 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:58.160356 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e4f0213e-97d5-4751-892a-8abd1f5151da tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.225056 Jul 20 17:52:58.163271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 238/467] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:57 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:58.296515 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-af14b3fe-d16f-4e2a-85dd-40c28b7ad264 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:58.304405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-af14b3fe-d16f-4e2a-85dd-40c28b7ad264 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.204788 Jul 20 17:52:58.305011 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 230/468] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:58 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:52:59.179310 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:59.186556 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:59.186556 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:59.187160 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:59.187928 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:59.188365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:59.323569 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0872ee1e-bfb1-4b5c-b3c7-98b79a7beec6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:52:59.324998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0872ee1e-bfb1-4b5c-b3c7-98b79a7beec6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:52:59.333193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0872ee1e-bfb1-4b5c-b3c7-98b79a7beec6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:59.333645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0872ee1e-bfb1-4b5c-b3c7-98b79a7beec6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:59.334506 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0872ee1e-bfb1-4b5c-b3c7-98b79a7beec6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:52:59.335127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0872ee1e-bfb1-4b5c-b3c7-98b79a7beec6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:52:59.594649 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:59.603499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:59.605705 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:59.607220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c8814af6-9c51-46b1-8a51-f56578352cfd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.431985 Jul 20 17:52:59.608532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 239/469] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:52:59 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:52:59.667432 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0872ee1e-bfb1-4b5c-b3c7-98b79a7beec6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:52:59.675406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0872ee1e-bfb1-4b5c-b3c7-98b79a7beec6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.356313 Jul 20 17:52:59.683726 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 231/470] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:52:59 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:00.625666 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:00.626299 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:00.633306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:00.633755 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:00.634528 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:00.634958 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:00.693362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-85575f80-42b0-454f-90aa-279189ecf5f4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:00.701109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-85575f80-42b0-454f-90aa-279189ecf5f4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:00.718688 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-85575f80-42b0-454f-90aa-279189ecf5f4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:00.719676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-85575f80-42b0-454f-90aa-279189ecf5f4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:00.720564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-85575f80-42b0-454f-90aa-279189ecf5f4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:00.721261 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-85575f80-42b0-454f-90aa-279189ecf5f4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:00.804143 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:00.813304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:00.814803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:00.815970 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-93898527-0aff-4cb7-b82a-afd4f3f0d9d1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.194259 Jul 20 17:53:00.816788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 240/471] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:00 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:00.871744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-85575f80-42b0-454f-90aa-279189ecf5f4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:00.879244 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-85575f80-42b0-454f-90aa-279189ecf5f4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.190085 Jul 20 17:53:00.879770 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 232/472] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:00 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:01.833915 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:01.834528 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:01.841058 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:01.841506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:01.842269 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:01.842705 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:01.903332 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-db8583e4-76e9-4859-8da4-65b21a5b7d9e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:01.903332 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-db8583e4-76e9-4859-8da4-65b21a5b7d9e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:01.904880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db8583e4-76e9-4859-8da4-65b21a5b7d9e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:01.905340 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db8583e4-76e9-4859-8da4-65b21a5b7d9e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:01.906118 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db8583e4-76e9-4859-8da4-65b21a5b7d9e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:01.906616 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db8583e4-76e9-4859-8da4-65b21a5b7d9e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:02.027854 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:02.037991 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:02.039497 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:02.040695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cb082687-e3fd-4ee2-a1b9-7b58cf550e72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.210655 Jul 20 17:53:02.041442 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 241/473] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:01 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:02.074346 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-db8583e4-76e9-4859-8da4-65b21a5b7d9e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:02.081955 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-db8583e4-76e9-4859-8da4-65b21a5b7d9e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1501 microversion: 2.1 time: 0.190655 Jul 20 17:53:02.082533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 233/474] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:01 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:02.098897 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa4a9106-ac26-4795-8d2e-0839f2150292"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:02.100749 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:02.106335 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:02.107349 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:02.108113 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:02.108606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:02.133343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] HTTP exception thrown: Cannot 'attach_volume' instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae while it is in vm_state rescued Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Request method failure captured: Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: POST /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae/os-volume_attachments HTTP/1.1 Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 74 Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2ECFR8Chf_-oC5r4ltXJ63KUnxvQuEmcxamgLZkPzUQBaz6u_DRxVxJh81w11ssb1D_5EnfdMiUucEa-pyrvFRYV06pWwIIiHHbWBmycepP5B806CKpRGnYDA__HD_ppgbQ3YrlOygxDiDxAFTS3iVoixCYUCzSkehzwaC58aAjvgvc Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:53:02.134982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bde6b55e64864d188ee5fafc4b9edc4a"}]}] Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 8daac4acc2fb4d47a7549ef710a70fca Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {"volumeAttachment": {"volumeId": "aa4a9106-ac26-4795-8d2e-0839f2150292"}} Jul 20 17:53:02.136606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Cannot 'attach_volume' instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae while it is in vm_state rescued Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'server_id': '9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae', 'body': {'volumeAttachment': {'volumeId': 'aa4a9106-ac26-4795-8d2e-0839f2150292'}}} Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:53:02.137505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae while it is in vm_state rescued Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:02.139028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:02.140406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:53:02.140406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:53:02.140406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae while it is in vm_state rescued Jul 20 17:53:02.140406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:02.140406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Returning 409 to user: Cannot 'attach_volume' instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae while it is in vm_state rescued {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:53:02.140406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c07bddf4-68b1-4f0d-a7f8-047aa79fe4c8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041582 Jul 20 17:53:02.140406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 242/475] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:53:02 2022] POST /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 17:53:02.170427 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0b24d3b4-87c9-4609-9fe2-a63c64e7b240 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:02.170427 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0b24d3b4-87c9-4609-9fe2-a63c64e7b240 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:02.170427 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b24d3b4-87c9-4609-9fe2-a63c64e7b240 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:02.170427 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b24d3b4-87c9-4609-9fe2-a63c64e7b240 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:02.170798 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b24d3b4-87c9-4609-9fe2-a63c64e7b240 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:02.170798 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b24d3b4-87c9-4609-9fe2-a63c64e7b240 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:02.409514 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0b24d3b4-87c9-4609-9fe2-a63c64e7b240 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae/action" status: 202 len: 0 microversion: 2.1 time: 0.267634 Jul 20 17:53:02.410059 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 234/476] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:53:02 2022] POST /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 17:53:02.418141 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f3104aad-dc9a-4d7c-a843-487b125ab592 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:02.419843 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f3104aad-dc9a-4d7c-a843-487b125ab592 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:02.426116 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3104aad-dc9a-4d7c-a843-487b125ab592 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:02.426571 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3104aad-dc9a-4d7c-a843-487b125ab592 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:02.427382 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3104aad-dc9a-4d7c-a843-487b125ab592 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:02.427838 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3104aad-dc9a-4d7c-a843-487b125ab592 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:02.569982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f3104aad-dc9a-4d7c-a843-487b125ab592 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:02.578808 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f3104aad-dc9a-4d7c-a843-487b125ab592 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1509 microversion: 2.1 time: 0.164529 Jul 20 17:53:02.579549 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 243/477] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:02 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:03.059929 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:03.060656 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:03.067013 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:03.067462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:03.068221 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:03.068680 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:03.197668 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4be23a14-a81e-4cc2-8a45-bf9ce56a1af8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:03.198416 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4be23a14-a81e-4cc2-8a45-bf9ce56a1af8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:03.205773 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4be23a14-a81e-4cc2-8a45-bf9ce56a1af8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:03.206365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4be23a14-a81e-4cc2-8a45-bf9ce56a1af8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:03.207208 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4be23a14-a81e-4cc2-8a45-bf9ce56a1af8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:03.207739 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4be23a14-a81e-4cc2-8a45-bf9ce56a1af8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:03.208788 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:03.217218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:03.218724 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:03.219872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-774a1018-0faf-4bf5-aedf-1774c9871512 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.164735 Jul 20 17:53:03.220456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 235/478] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:03 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:03.333525 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4be23a14-a81e-4cc2-8a45-bf9ce56a1af8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:03.341619 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4be23a14-a81e-4cc2-8a45-bf9ce56a1af8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1594 microversion: 2.1 time: 0.147789 Jul 20 17:53:03.342183 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 244/479] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:03 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1594 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:03.597028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-056b1d4f-2960-4fd0-b1c0-31035ec32dd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:03.597662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-056b1d4f-2960-4fd0-b1c0-31035ec32dd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:03.603613 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-056b1d4f-2960-4fd0-b1c0-31035ec32dd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:03.604139 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-056b1d4f-2960-4fd0-b1c0-31035ec32dd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:03.604939 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-056b1d4f-2960-4fd0-b1c0-31035ec32dd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:03.605378 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-056b1d4f-2960-4fd0-b1c0-31035ec32dd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:03.734910 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-056b1d4f-2960-4fd0-b1c0-31035ec32dd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:03.742826 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-056b1d4f-2960-4fd0-b1c0-31035ec32dd2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1509 microversion: 2.1 time: 0.149565 Jul 20 17:53:03.743385 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 236/480] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:03 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:04.238529 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:04.239083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:04.241347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=58 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:04.246060 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:04.246498 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:04.247806 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:04.248245 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:04.380353 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:04.389550 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:04.391578 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:04.392803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3d578c7e-9ae9-48df-9291-4e6d9fad7e3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.158212 Jul 20 17:53:04.393358 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 245/481] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:04 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:04.760488 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8393d9c2-ab20-42c9-9910-6632760a2dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:04.761134 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8393d9c2-ab20-42c9-9910-6632760a2dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:04.768282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8393d9c2-ab20-42c9-9910-6632760a2dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:04.768721 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8393d9c2-ab20-42c9-9910-6632760a2dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:04.769488 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8393d9c2-ab20-42c9-9910-6632760a2dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:04.769927 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8393d9c2-ab20-42c9-9910-6632760a2dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:04.911327 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8393d9c2-ab20-42c9-9910-6632760a2dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:04.918735 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8393d9c2-ab20-42c9-9910-6632760a2dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1509 microversion: 2.1 time: 0.162166 Jul 20 17:53:04.919496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 237/482] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:04 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:05.410995 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:05.411612 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:05.418840 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:05.419951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:05.420949 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:05.421175 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:05.629923 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:05.640114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:05.641689 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:05.642892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-973b05c1-0dbb-498b-9307-a2407823a7bf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.235911 Jul 20 17:53:05.660205 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 246/483] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:05 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:05.936170 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-520d9721-bdb3-43f4-9e3b-c38d15a008fd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:05.942740 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-520d9721-bdb3-43f4-9e3b-c38d15a008fd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:05.962589 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-520d9721-bdb3-43f4-9e3b-c38d15a008fd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:05.968307 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-520d9721-bdb3-43f4-9e3b-c38d15a008fd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:05.968935 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-520d9721-bdb3-43f4-9e3b-c38d15a008fd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:05.969379 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-520d9721-bdb3-43f4-9e3b-c38d15a008fd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:06.019445 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-5abfa790-2190-4173-9638-05b79fe43e87 req-4a568b0c-f4c1-4cf6-b516-dead16c155af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3192a390-865f-408d-adb6-01f03593249c", "tag": "05bc7328-58f7-4b9a-89df-2347f267ebb3"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:06.043083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-5abfa790-2190-4173-9638-05b79fe43e87 req-4a568b0c-f4c1-4cf6-b516-dead16c155af service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:06.044130 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-5abfa790-2190-4173-9638-05b79fe43e87 req-4a568b0c-f4c1-4cf6-b516-dead16c155af service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:06.060244 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-5abfa790-2190-4173-9638-05b79fe43e87 req-4a568b0c-f4c1-4cf6-b516-dead16c155af service nova] Creating event network-changed:05bc7328-58f7-4b9a-89df-2347f267ebb3 for instance 3192a390-865f-408d-adb6-01f03593249c on hv-cinder-84984 Jul 20 17:53:06.065599 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-5abfa790-2190-4173-9638-05b79fe43e87 req-4a568b0c-f4c1-4cf6-b516-dead16c155af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049943 Jul 20 17:53:06.066532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 247/484] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:06.152083 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-520d9721-bdb3-43f4-9e3b-c38d15a008fd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:06.160323 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-520d9721-bdb3-43f4-9e3b-c38d15a008fd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1509 microversion: 2.1 time: 0.228820 Jul 20 17:53:06.160919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 238/485] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:05 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:06.667199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:06.667883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:06.674642 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:06.675106 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:06.675853 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:06.676280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:06.851108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:06.860135 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:06.861685 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:06.862850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c3b2887f-ad37-4b93-87d1-6f450244eaa3 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.200096 Jul 20 17:53:06.863411 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 248/486] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:06 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:07.177170 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8c41c399-d549-42e3-9aee-47a08c2e8cbf tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:07.177782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8c41c399-d549-42e3-9aee-47a08c2e8cbf tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:07.184037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8c41c399-d549-42e3-9aee-47a08c2e8cbf tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:07.186096 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8c41c399-d549-42e3-9aee-47a08c2e8cbf tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:07.186096 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8c41c399-d549-42e3-9aee-47a08c2e8cbf tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:07.186096 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8c41c399-d549-42e3-9aee-47a08c2e8cbf tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:07.203075 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-abbd6ded-d2d2-4ac6-a528-b71c9912fcf7 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:07.203893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-abbd6ded-d2d2-4ac6-a528-b71c9912fcf7 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:07.209914 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-abbd6ded-d2d2-4ac6-a528-b71c9912fcf7 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:07.210573 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-abbd6ded-d2d2-4ac6-a528-b71c9912fcf7 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:07.211328 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-abbd6ded-d2d2-4ac6-a528-b71c9912fcf7 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:07.211754 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-abbd6ded-d2d2-4ac6-a528-b71c9912fcf7 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:07.238295 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-abbd6ded-d2d2-4ac6-a528-b71c9912fcf7 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:53:07.362753 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8c41c399-d549-42e3-9aee-47a08c2e8cbf tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:07.370285 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8c41c399-d549-42e3-9aee-47a08c2e8cbf tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1509 microversion: 2.1 time: 0.197033 Jul 20 17:53:07.370849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 239/487] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:07 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:07.445009 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:07.673534 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-abbd6ded-d2d2-4ac6-a528-b71c9912fcf7 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 204 len: 0 microversion: 2.1 time: 0.474731 Jul 20 17:53:07.674190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 249/488] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:53:07 2022] DELETE /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 17:53:07.682260 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-40b8632e-0e49-4a00-bfd0-73de70aefc2d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:07.682899 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-40b8632e-0e49-4a00-bfd0-73de70aefc2d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:07.689758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40b8632e-0e49-4a00-bfd0-73de70aefc2d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:07.690205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40b8632e-0e49-4a00-bfd0-73de70aefc2d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:07.690962 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40b8632e-0e49-4a00-bfd0-73de70aefc2d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:07.691398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-40b8632e-0e49-4a00-bfd0-73de70aefc2d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:07.823500 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-40b8632e-0e49-4a00-bfd0-73de70aefc2d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:07.832108 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-40b8632e-0e49-4a00-bfd0-73de70aefc2d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1560 microversion: 2.1 time: 0.153687 Jul 20 17:53:07.832721 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 240/489] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:07 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:07.881545 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:07.882271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:07.888740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:07.889186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:07.889942 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:07.890379 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:08.080071 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:08.088943 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:08.090576 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:08.092343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-dbd9cf0e-e420-4ff1-b109-0468f9918fde tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.215094 Jul 20 17:53:08.092985 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 250/490] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:07 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:08.387408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-97b8758a-a191-40c3-b878-d4d8761d3f79 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:08.388262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-97b8758a-a191-40c3-b878-d4d8761d3f79 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:08.394869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-97b8758a-a191-40c3-b878-d4d8761d3f79 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:08.395394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-97b8758a-a191-40c3-b878-d4d8761d3f79 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:08.396162 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-97b8758a-a191-40c3-b878-d4d8761d3f79 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:08.396623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-97b8758a-a191-40c3-b878-d4d8761d3f79 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:08.558886 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-97b8758a-a191-40c3-b878-d4d8761d3f79 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:08.566679 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-97b8758a-a191-40c3-b878-d4d8761d3f79 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1509 microversion: 2.1 time: 0.183495 Jul 20 17:53:08.567245 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 241/491] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:08 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:08.848755 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cb0e8e78-9f9d-4f32-82f5-f2f28040f180 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:08.849355 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cb0e8e78-9f9d-4f32-82f5-f2f28040f180 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:08.855702 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb0e8e78-9f9d-4f32-82f5-f2f28040f180 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:08.856147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb0e8e78-9f9d-4f32-82f5-f2f28040f180 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:08.857480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb0e8e78-9f9d-4f32-82f5-f2f28040f180 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:08.857913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb0e8e78-9f9d-4f32-82f5-f2f28040f180 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.034340 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cb0e8e78-9f9d-4f32-82f5-f2f28040f180 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:09.041740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cb0e8e78-9f9d-4f32-82f5-f2f28040f180 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1514 microversion: 2.1 time: 0.197062 Jul 20 17:53:09.042298 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 251/492] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:08 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:09.114944 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:09.115573 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:09.123185 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:09.123632 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.124626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:09.125061 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.248369 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1a9591fd-b8aa-4193-9d6f-ef4ce0897949 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-615931283"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:09.249276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1a9591fd-b8aa-4193-9d6f-ef4ce0897949 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:09.255357 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a9591fd-b8aa-4193-9d6f-ef4ce0897949 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:09.255867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a9591fd-b8aa-4193-9d6f-ef4ce0897949 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.256713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a9591fd-b8aa-4193-9d6f-ef4ce0897949 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:09.257228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a9591fd-b8aa-4193-9d6f-ef4ce0897949 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.274490 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:09.283332 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:09.284872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:09.286032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-be9ad9c5-271e-42a7-adfa-a6adb2fc76e2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.178376 Jul 20 17:53:09.286597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 242/493] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:09 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:09.388005 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.network.security_group_api [None req-1a9591fd-b8aa-4193-9d6f-ef4ce0897949 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Adding security group 8b001fd3-c0ff-44ac-b09f-080a5f42198e to port 05bc7328-58f7-4b9a-89df-2347f267ebb3 Jul 20 17:53:09.584678 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-89092a01-9e79-4841-87de-560185276a58 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:09.585362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-89092a01-9e79-4841-87de-560185276a58 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:09.592785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89092a01-9e79-4841-87de-560185276a58 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:09.593990 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89092a01-9e79-4841-87de-560185276a58 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.594854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89092a01-9e79-4841-87de-560185276a58 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:09.595361 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-89092a01-9e79-4841-87de-560185276a58 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.776981 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-89092a01-9e79-4841-87de-560185276a58 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:09.784923 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-89092a01-9e79-4841-87de-560185276a58 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1515 microversion: 2.1 time: 0.204266 Jul 20 17:53:09.785521 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 243/494] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:09 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:09.883133 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1a9591fd-b8aa-4193-9d6f-ef4ce0897949 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "POST /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/action" status: 202 len: 0 microversion: 2.1 time: 0.639437 Jul 20 17:53:09.884016 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 252/495] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:53:09 2022] POST /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 17:53:09.891458 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-c1154fdd-456a-4ac4-a4c3-8f57991a0127 req-5d80125d-f2d6-4aa7-b963-89a1e720060a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3192a390-865f-408d-adb6-01f03593249c", "tag": "05bc7328-58f7-4b9a-89df-2347f267ebb3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:09.894446 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-819cf8a7-3a9a-4fde-a792-52c0ba1d32c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:09.895423 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-819cf8a7-3a9a-4fde-a792-52c0ba1d32c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:09.906603 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c1154fdd-456a-4ac4-a4c3-8f57991a0127 req-5d80125d-f2d6-4aa7-b963-89a1e720060a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:09.906603 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c1154fdd-456a-4ac4-a4c3-8f57991a0127 req-5d80125d-f2d6-4aa7-b963-89a1e720060a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.909519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:09.915051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-819cf8a7-3a9a-4fde-a792-52c0ba1d32c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:09.915629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-819cf8a7-3a9a-4fde-a792-52c0ba1d32c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.917036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-819cf8a7-3a9a-4fde-a792-52c0ba1d32c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:09.917583 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-819cf8a7-3a9a-4fde-a792-52c0ba1d32c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:09.918699 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-c1154fdd-456a-4ac4-a4c3-8f57991a0127 req-5d80125d-f2d6-4aa7-b963-89a1e720060a service nova] Creating event network-changed:05bc7328-58f7-4b9a-89df-2347f267ebb3 for instance 3192a390-865f-408d-adb6-01f03593249c on hv-cinder-84984 Jul 20 17:53:09.929308 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-c1154fdd-456a-4ac4-a4c3-8f57991a0127 req-5d80125d-f2d6-4aa7-b963-89a1e720060a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042061 Jul 20 17:53:09.934436 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 244/496] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:10.059664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a52750b5-d335-4512-b36b-7d3e2b7dbe0d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:10.060645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a52750b5-d335-4512-b36b-7d3e2b7dbe0d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:10.072727 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a52750b5-d335-4512-b36b-7d3e2b7dbe0d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:10.074005 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a52750b5-d335-4512-b36b-7d3e2b7dbe0d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:10.075078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a52750b5-d335-4512-b36b-7d3e2b7dbe0d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:10.075849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a52750b5-d335-4512-b36b-7d3e2b7dbe0d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:10.189499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-819cf8a7-3a9a-4fde-a792-52c0ba1d32c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:10.200961 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-819cf8a7-3a9a-4fde-a792-52c0ba1d32c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1640 microversion: 2.1 time: 0.310805 Jul 20 17:53:10.201554 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 253/497] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:09 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1640 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:10.272177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a52750b5-d335-4512-b36b-7d3e2b7dbe0d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:10.282997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a52750b5-d335-4512-b36b-7d3e2b7dbe0d tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1514 microversion: 2.1 time: 0.228234 Jul 20 17:53:10.284874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 245/498] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:10 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:10.305214 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:10.306379 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:10.314178 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:10.318142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:10.318142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:10.318142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:10.462125 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:10.472474 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:10.478441 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:10.478441 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9d0a88ce-1f7d-475d-af77-3585c72f2e02 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.174055 Jul 20 17:53:10.478441 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 254/499] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:10 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:11.301044 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-efca6fb1-2941-436f-a6aa-edcf76b48106 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:11.301650 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-efca6fb1-2941-436f-a6aa-edcf76b48106 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:11.304193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=64 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:11.309104 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-efca6fb1-2941-436f-a6aa-edcf76b48106 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:11.310041 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-efca6fb1-2941-436f-a6aa-edcf76b48106 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:11.310920 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-efca6fb1-2941-436f-a6aa-edcf76b48106 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:11.311363 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-efca6fb1-2941-436f-a6aa-edcf76b48106 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:11.445574 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-efca6fb1-2941-436f-a6aa-edcf76b48106 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:11.450105 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8dff0491-36c8-435e-8fe3-b54788d11e8d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'create', calling method: .version_select at 0x7f7d3d86bdc0>, body: {"keypair": {"name": "tempest-keypair-1501291331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESyIkL7MqqFMRiG7UJqaHGq0S21vP88lbJh9RUDYZ9PyiS+7/QwHX3supURFoa1qNTZFPXsfZ47d4QKSkl/uV+0wwb3cDAex308i0HsVRFySsvV6xbKBUJklwSWIEtjoQ=="}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:11.453449 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-efca6fb1-2941-436f-a6aa-edcf76b48106 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1514 microversion: 2.1 time: 0.156318 Jul 20 17:53:11.454027 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 246/500] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:11 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:11.464410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-8dff0491-36c8-435e-8fe3-b54788d11e8d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Getting quotas for project bde6b55e64864d188ee5fafc4b9edc4a. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:53:11.468244 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-8dff0491-36c8-435e-8fe3-b54788d11e8d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Getting quotas for user 8daac4acc2fb4d47a7549ef710a70fca and project bde6b55e64864d188ee5fafc4b9edc4a. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:53:11.492966 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:11.493572 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:11.499622 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:11.500073 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:11.500859 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:11.501293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:11.572232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8dff0491-36c8-435e-8fe3-b54788d11e8d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125907 Jul 20 17:53:11.572863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 255/501] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 17:53:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:11.635276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:11.644474 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:11.645935 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:11.647088 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-81f01cc2-1052-4dff-989a-624890344cc1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.157923 Jul 20 17:53:11.647644 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 247/502] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:11 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:53:12.470704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e7f8ffef-7174-4f06-9bc0-89b8f1117f23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:12.471906 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e7f8ffef-7174-4f06-9bc0-89b8f1117f23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:12.478036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e7f8ffef-7174-4f06-9bc0-89b8f1117f23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:12.483577 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e7f8ffef-7174-4f06-9bc0-89b8f1117f23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:12.483577 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e7f8ffef-7174-4f06-9bc0-89b8f1117f23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:12.483577 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e7f8ffef-7174-4f06-9bc0-89b8f1117f23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:12.665512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:12.666111 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:12.672849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:12.673292 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:12.674054 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:12.674484 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:12.823821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e7f8ffef-7174-4f06-9bc0-89b8f1117f23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:12.832647 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e7f8ffef-7174-4f06-9bc0-89b8f1117f23 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1514 microversion: 2.1 time: 0.366919 Jul 20 17:53:12.842348 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 256/503] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:12 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:13.061543 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-7641b3e9-1701-4e68-bc0c-d521017a5fbd req-f8681511-b57e-4fb3-9432-6c44da92feb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b246c9-d9df-4348-9d5a-61c1170b1951", "name": "network-vif-plugged", "status": "completed", "tag": "c0861927-5eef-4dee-a02c-a3bed737a580"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:13.077059 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-7641b3e9-1701-4e68-bc0c-d521017a5fbd req-f8681511-b57e-4fb3-9432-6c44da92feb0 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:13.077671 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-7641b3e9-1701-4e68-bc0c-d521017a5fbd req-f8681511-b57e-4fb3-9432-6c44da92feb0 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:13.100786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-7641b3e9-1701-4e68-bc0c-d521017a5fbd req-f8681511-b57e-4fb3-9432-6c44da92feb0 service nova] Creating event network-vif-plugged:c0861927-5eef-4dee-a02c-a3bed737a580 for instance 45b246c9-d9df-4348-9d5a-61c1170b1951 on hv-cinder-84984 Jul 20 17:53:13.107948 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-7641b3e9-1701-4e68-bc0c-d521017a5fbd req-f8681511-b57e-4fb3-9432-6c44da92feb0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058179 Jul 20 17:53:13.112875 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 257/504] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:13.239810 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:13.248399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:13.254064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:13.254064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-46e3f0da-a9bc-4dc6-a8ef-6e92d6b6758f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.589828 Jul 20 17:53:13.261783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 248/505] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:12 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:53:13.454461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-c5b14a64-2864-433f-8a82-49d985c8c5df req-495ae6af-79fc-4813-978c-a281bac0441c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd17b0fa-8b69-4617-8534-d173f891cb78", "name": "network-vif-deleted", "tag": "9da57d0b-3ca2-40d8-bd55-3eab7a018c3c"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:13.462712 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-c5b14a64-2864-433f-8a82-49d985c8c5df req-495ae6af-79fc-4813-978c-a281bac0441c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:13.463163 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-c5b14a64-2864-433f-8a82-49d985c8c5df req-495ae6af-79fc-4813-978c-a281bac0441c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:13.474258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-c5b14a64-2864-433f-8a82-49d985c8c5df req-495ae6af-79fc-4813-978c-a281bac0441c service nova] Creating event network-vif-deleted:9da57d0b-3ca2-40d8-bd55-3eab7a018c3c for instance bd17b0fa-8b69-4617-8534-d173f891cb78 on hv-cinder-84984 Jul 20 17:53:13.478978 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-c5b14a64-2864-433f-8a82-49d985c8c5df req-495ae6af-79fc-4813-978c-a281bac0441c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029305 Jul 20 17:53:13.479561 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 258/506] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:13.851246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-34a97841-44c1-48d0-a195-e383a328aefa tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:13.854775 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-34a97841-44c1-48d0-a195-e383a328aefa tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:13.861063 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34a97841-44c1-48d0-a195-e383a328aefa tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:13.861697 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34a97841-44c1-48d0-a195-e383a328aefa tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:13.862457 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34a97841-44c1-48d0-a195-e383a328aefa tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:13.863146 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34a97841-44c1-48d0-a195-e383a328aefa tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:13.984548 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-34a97841-44c1-48d0-a195-e383a328aefa tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:13.991333 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-34a97841-44c1-48d0-a195-e383a328aefa tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1303 microversion: 2.1 time: 0.145177 Jul 20 17:53:13.991907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 249/507] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:13 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:14.119555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-209703879", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2628e491-f238-47ac-a0ee-cb782ad8236f"}], "security_groups": [{"name": "tempest-securitygroup--1504259880"}], "key_name": "tempest-keypair-1501291331", "user_data": "}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:14.221346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] validate_networks() for [('2628e491-f238-47ac-a0ee-cb782ad8236f', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:53:14.268964 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:14.269567 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:14.275419 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:14.275858 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:14.276638 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:14.277069 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:14.473507 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:14.482813 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:14.484318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:14.485533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5805d55c-f403-4d93-9695-2b0d11c04650 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.220510 Jul 20 17:53:14.486092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 250/508] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:14 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:53:14.657032 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:53:14.657608 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:53:14.657954 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:53:14.658359 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:53:14.658774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:53:14.667682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:14.668124 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:14.669454 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:14.669883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:14.686663 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Getting quotas for project bde6b55e64864d188ee5fafc4b9edc4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:53:14.690952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Getting quotas for user 8daac4acc2fb4d47a7549ef710a70fca and project bde6b55e64864d188ee5fafc4b9edc4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:53:14.701921 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:53:14.704204 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:53:14.835444 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7edfe729-0e29-45d1-a86d-8265e98c7e77 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.720500 Jul 20 17:53:14.836086 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 259/509] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:53:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:53:14.846652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-36ee9b80-e417-424f-b143-ae89bca07ca1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:14.847366 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-36ee9b80-e417-424f-b143-ae89bca07ca1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:14.902225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-36ee9b80-e417-424f-b143-ae89bca07ca1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:14.909613 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-36ee9b80-e417-424f-b143-ae89bca07ca1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1245 microversion: 2.1 time: 0.066836 Jul 20 17:53:14.910210 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 251/510] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:14 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:15.007094 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:15.007708 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:15.014677 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:15.015223 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:15.015870 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:15.016304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:15.048004 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:15.048506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:15.048954 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lazy-loading 'fault' on Instance uuid bd17b0fa-8b69-4617-8534-d173f891cb78 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:53:15.093042 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:15.100703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fcf2f817-39b0-4bb8-8489-25e2dbb957ae tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 200 len: 1308 microversion: 2.1 time: 0.097423 Jul 20 17:53:15.101285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 260/511] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:15 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:15.503758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:15.504383 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:15.511830 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:15.512281 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:15.513641 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:15.514078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:15.647537 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:15.656566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:15.658062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:15.659970 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-427a8c53-6d69-4268-9938-e444dfb81973 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.159980 Jul 20 17:53:15.659970 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 252/512] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:15 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:15.926409 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-90d18890-4238-4ec2-9169-487271b7569b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:15.927026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-90d18890-4238-4ec2-9169-487271b7569b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:15.933509 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-90d18890-4238-4ec2-9169-487271b7569b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:15.933987 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-90d18890-4238-4ec2-9169-487271b7569b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:15.934759 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-90d18890-4238-4ec2-9169-487271b7569b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:15.935360 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-90d18890-4238-4ec2-9169-487271b7569b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:15.997096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-90d18890-4238-4ec2-9169-487271b7569b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:16.004620 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-90d18890-4238-4ec2-9169-487271b7569b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1249 microversion: 2.1 time: 0.082007 Jul 20 17:53:16.005186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 261/513] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:15 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:16.124520 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:16.125137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: bd17b0fa-8b69-4617-8534-d173f891cb78] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:16.132942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:16.133636 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:16.134810 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:16.135484 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:16.156938 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] HTTP exception thrown: Instance bd17b0fa-8b69-4617-8534-d173f891cb78 could not be found. Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Request method failure captured: Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 HTTP/1.1 Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2ECgx95CTW4xbs2MSV-aUcIq6IANgMYt7GjUZtIYtDiIq8fRBfxhQ9sXMh9s9KH_T-1Fd6pW91x4JbxngCygUqFDU68ARhszqaaF27cfvaTt3Fbj_fST0wHMwBeGoTz5c8SRD4_kUaT7NsJxilY4qvTyXlK6IZQidF1WTZqTYGmxsW0 Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 10e93d9f177d4ed5bba338ba68547bf7 Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1055718646 Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:53:16.159598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_10e93d9f177d4ed5bba338ba68547bf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10e93d9f177d4ed5bba338ba68547bf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10e93d9f177d4ed5bba338ba68547bf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/10e93d9f177d4ed5bba338ba68547bf7"}]}] Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesSnapshotTestJSON-1055718646 Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 10e93d9f177d4ed5bba338ba68547bf7 Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1055718646 Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesSnapshotTestJSON-1055718646-project Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 2bc0d03b364946a5b8af3db4e9fd4780 Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesSnapshotTestJSON-1055718646-project Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance bd17b0fa-8b69-4617-8534-d173f891cb78 could not be found. Jul 20 17:53:16.161150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'bd17b0fa-8b69-4617-8534-d173f891cb78'} Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd17b0fa-8b69-4617-8534-d173f891cb78 could not be found. Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:53:16.162050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd17b0fa-8b69-4617-8534-d173f891cb78 could not be found. Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd17b0fa-8b69-4617-8534-d173f891cb78 could not be found. Jul 20 17:53:16.164456 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:16.165540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Returning 404 to user: Instance bd17b0fa-8b69-4617-8534-d173f891cb78 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:53:16.165540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8f8caeec-cd9b-40ea-aa6e-2aae5e060ed9 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78" status: 404 len: 111 microversion: 2.1 time: 0.043200 Jul 20 17:53:16.165540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 253/514] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:16 2022] GET /compute/v2.1/servers/bd17b0fa-8b69-4617-8534-d173f891cb78 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:53:16.677769 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:16.678410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:16.684403 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:16.684937 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:16.685687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:16.688672 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:16.822356 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:16.832131 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:16.833766 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:16.834935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5fc7b3ae-5e0e-48d4-9ad6-c46cb4970775 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.161108 Jul 20 17:53:16.835506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 262/515] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:16 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:17.022158 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-64ab1c57-ff02-4211-8bd5-296885fb8741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:17.022883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-64ab1c57-ff02-4211-8bd5-296885fb8741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:17.029166 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64ab1c57-ff02-4211-8bd5-296885fb8741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:17.029607 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64ab1c57-ff02-4211-8bd5-296885fb8741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:17.030362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64ab1c57-ff02-4211-8bd5-296885fb8741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:17.030793 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64ab1c57-ff02-4211-8bd5-296885fb8741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:17.100224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-64ab1c57-ff02-4211-8bd5-296885fb8741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:17.108369 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-64ab1c57-ff02-4211-8bd5-296885fb8741 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1297 microversion: 2.1 time: 0.090075 Jul 20 17:53:17.108959 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 254/516] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:17 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:17.852130 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:17.852794 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:17.859873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:17.860324 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:17.861140 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:17.861580 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:17.990593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:17.998852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:18.000345 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:18.001536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-83465b14-cd68-49bb-a7e8-a4c3abd212e6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.153339 Jul 20 17:53:18.002097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 263/517] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:17 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:18.125682 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-99f2ad6a-ca7d-48a2-9fa8-164821a3a8f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:18.126854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-99f2ad6a-ca7d-48a2-9fa8-164821a3a8f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:18.133615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99f2ad6a-ca7d-48a2-9fa8-164821a3a8f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:18.134067 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99f2ad6a-ca7d-48a2-9fa8-164821a3a8f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:18.134837 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99f2ad6a-ca7d-48a2-9fa8-164821a3a8f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:18.135272 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99f2ad6a-ca7d-48a2-9fa8-164821a3a8f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:18.196487 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-99f2ad6a-ca7d-48a2-9fa8-164821a3a8f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:18.204387 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-99f2ad6a-ca7d-48a2-9fa8-164821a3a8f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1297 microversion: 2.1 time: 0.082551 Jul 20 17:53:18.204986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 255/518] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:18 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:19.019659 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:19.020305 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:19.026816 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.027267 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.028027 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.029084 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.157659 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:19.166043 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:19.167553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:19.168736 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-47ea5f53-6460-4143-abfb-11d4b0d81c54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1809 microversion: 2.20 time: 0.152965 Jul 20 17:53:19.169298 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 264/519] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:19 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:53:19.222849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4361bb3e-d3b4-4764-b72e-bc7d096c3c05 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:19.223388 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4361bb3e-d3b4-4764-b72e-bc7d096c3c05 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:19.229880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4361bb3e-d3b4-4764-b72e-bc7d096c3c05 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.230328 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4361bb3e-d3b4-4764-b72e-bc7d096c3c05 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.231082 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4361bb3e-d3b4-4764-b72e-bc7d096c3c05 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.231547 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4361bb3e-d3b4-4764-b72e-bc7d096c3c05 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.291489 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4361bb3e-d3b4-4764-b72e-bc7d096c3c05 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:19.298898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4361bb3e-d3b4-4764-b72e-bc7d096c3c05 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1297 microversion: 2.1 time: 0.079942 Jul 20 17:53:19.299488 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 256/520] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:19 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1297 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:19.713154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-139de1c7-fe0f-4bd7-9b51-01ebde5342d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:19.713642 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-139de1c7-fe0f-4bd7-9b51-01ebde5342d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:19.719752 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-139de1c7-fe0f-4bd7-9b51-01ebde5342d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.720187 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-139de1c7-fe0f-4bd7-9b51-01ebde5342d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.720960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-139de1c7-fe0f-4bd7-9b51-01ebde5342d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.721495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-139de1c7-fe0f-4bd7-9b51-01ebde5342d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.746346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-139de1c7-fe0f-4bd7-9b51-01ebde5342d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1/ips" status: 200 len: 150 microversion: 2.1 time: 0.037445 Jul 20 17:53:19.746924 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 265/521] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 17:53:19 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:19.758586 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4156de1-64f7-43f7-9d38-984b3c9508e4"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:19.769698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:19.769698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.769698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.769698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.770109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.845785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Invalid volume: volume b4156de1-64f7-43f7-9d38-984b3c9508e4 is already attached to instances: b8a9d731-6fac-4e62-a247-194eb02970a2 Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: POST /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1/os-volume_attachments HTTP/1.1 Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 74 Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:53:19.847585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {"volumeAttachment": {"volumeId": "b4156de1-64f7-43f7-9d38-984b3c9508e4"}} Jul 20 17:53:19.849218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Invalid volume: volume b4156de1-64f7-43f7-9d38-984b3c9508e4 is already attached to instances: b8a9d731-6fac-4e62-a247-194eb02970a2 Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'server_id': 'a959b594-9ce2-4fb1-b648-4016dfecb1b1', 'body': {'volumeAttachment': {'volumeId': 'b4156de1-64f7-43f7-9d38-984b3c9508e4'}}} Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b4156de1-64f7-43f7-9d38-984b3c9508e4 is already attached to instances: b8a9d731-6fac-4e62-a247-194eb02970a2 Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:19.850092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b4156de1-64f7-43f7-9d38-984b3c9508e4 is already attached to instances: b8a9d731-6fac-4e62-a247-194eb02970a2 Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:19.851580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:19.857312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:19.857312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:53:19.857312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:53:19.857312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b4156de1-64f7-43f7-9d38-984b3c9508e4 is already attached to instances: b8a9d731-6fac-4e62-a247-194eb02970a2 Jul 20 17:53:19.857312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:19.857312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 400 to user: Invalid volume: volume b4156de1-64f7-43f7-9d38-984b3c9508e4 is already attached to instances: b8a9d731-6fac-4e62-a247-194eb02970a2 {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:53:19.857312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-eb2668f3-c43f-468e-a2e9-6e71c829fc04 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094605 Jul 20 17:53:19.857312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 257/522] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:53:19 2022] POST /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:53:19.858837 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a7d6ff6d-0734-48eb-a909-9c315bff3d64 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:19.859388 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a7d6ff6d-0734-48eb-a909-9c315bff3d64 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:19.865636 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a7d6ff6d-0734-48eb-a909-9c315bff3d64 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.866083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a7d6ff6d-0734-48eb-a909-9c315bff3d64 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.866827 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a7d6ff6d-0734-48eb-a909-9c315bff3d64 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:19.867254 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a7d6ff6d-0734-48eb-a909-9c315bff3d64 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:19.892479 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a7d6ff6d-0734-48eb-a909-9c315bff3d64 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:53:20.186932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:20.188213 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:20.196955 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:20.197517 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:20.198284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:20.198758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:20.251017 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a7d6ff6d-0734-48eb-a909-9c315bff3d64 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 204 len: 0 microversion: 2.1 time: 0.396214 Jul 20 17:53:20.251705 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 266/523] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:53:19 2022] DELETE /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 17:53:20.259902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fec8d472-bfc9-4e67-b653-07dc25c683c5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:20.260733 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fec8d472-bfc9-4e67-b653-07dc25c683c5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:20.266744 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fec8d472-bfc9-4e67-b653-07dc25c683c5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:20.267256 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fec8d472-bfc9-4e67-b653-07dc25c683c5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:20.268078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fec8d472-bfc9-4e67-b653-07dc25c683c5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:20.268628 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fec8d472-bfc9-4e67-b653-07dc25c683c5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:20.374634 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:20.381734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:20.383272 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:20.384442 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4953023b-aae5-4047-9092-704adfedd3d2 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1796 microversion: 2.20 time: 0.201631 Jul 20 17:53:20.385011 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 258/524] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:53:20 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1796 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:53:20.390303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-155bfb15-ee1d-48d3-9f60-7a5b7564e447 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:20.390906 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-155bfb15-ee1d-48d3-9f60-7a5b7564e447 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:20.396973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-155bfb15-ee1d-48d3-9f60-7a5b7564e447 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:20.397570 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-155bfb15-ee1d-48d3-9f60-7a5b7564e447 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:20.398171 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-155bfb15-ee1d-48d3-9f60-7a5b7564e447 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:20.398609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-155bfb15-ee1d-48d3-9f60-7a5b7564e447 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:20.423864 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fec8d472-bfc9-4e67-b653-07dc25c683c5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:20.427549 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:20.432057 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fec8d472-bfc9-4e67-b653-07dc25c683c5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1681 microversion: 2.1 time: 0.176138 Jul 20 17:53:20.432662 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 267/525] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:20 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:20.462432 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-155bfb15-ee1d-48d3-9f60-7a5b7564e447 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:20.469712 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-155bfb15-ee1d-48d3-9f60-7a5b7564e447 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1297 microversion: 2.1 time: 0.083762 Jul 20 17:53:20.470264 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 259/526] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:20 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:21.451159 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-08ce1963-dd7c-4c80-a761-3f2d70de22a6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:21.451902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-08ce1963-dd7c-4c80-a761-3f2d70de22a6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:21.459556 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08ce1963-dd7c-4c80-a761-3f2d70de22a6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:21.460005 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08ce1963-dd7c-4c80-a761-3f2d70de22a6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:21.460792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08ce1963-dd7c-4c80-a761-3f2d70de22a6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:21.461219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08ce1963-dd7c-4c80-a761-3f2d70de22a6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:21.486863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7e3644f8-72cb-4c44-b14c-c71c60ec798f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:21.487604 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7e3644f8-72cb-4c44-b14c-c71c60ec798f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:21.494268 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e3644f8-72cb-4c44-b14c-c71c60ec798f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:21.494723 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e3644f8-72cb-4c44-b14c-c71c60ec798f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:21.495492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e3644f8-72cb-4c44-b14c-c71c60ec798f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:21.495930 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7e3644f8-72cb-4c44-b14c-c71c60ec798f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:21.566518 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7e3644f8-72cb-4c44-b14c-c71c60ec798f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:21.574154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7e3644f8-72cb-4c44-b14c-c71c60ec798f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1305 microversion: 2.1 time: 0.091097 Jul 20 17:53:21.574727 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 260/527] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:21 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:21.614582 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-08ce1963-dd7c-4c80-a761-3f2d70de22a6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:21.622505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-08ce1963-dd7c-4c80-a761-3f2d70de22a6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1681 microversion: 2.1 time: 0.174961 Jul 20 17:53:21.623067 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 268/528] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:21 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:22.594119 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7a958c4f-0e5c-4802-9877-812a82580488 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:22.594723 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7a958c4f-0e5c-4802-9877-812a82580488 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:22.601665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a958c4f-0e5c-4802-9877-812a82580488 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:22.602121 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a958c4f-0e5c-4802-9877-812a82580488 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:22.602885 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a958c4f-0e5c-4802-9877-812a82580488 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:22.603319 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a958c4f-0e5c-4802-9877-812a82580488 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:22.639692 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bcfc75fe-fbe7-4f27-a440-4ff938c86ec9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:22.640257 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-bcfc75fe-fbe7-4f27-a440-4ff938c86ec9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:22.648258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bcfc75fe-fbe7-4f27-a440-4ff938c86ec9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:22.649035 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bcfc75fe-fbe7-4f27-a440-4ff938c86ec9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:22.649803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bcfc75fe-fbe7-4f27-a440-4ff938c86ec9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:22.650235 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bcfc75fe-fbe7-4f27-a440-4ff938c86ec9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:22.698711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7a958c4f-0e5c-4802-9877-812a82580488 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:22.706125 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7a958c4f-0e5c-4802-9877-812a82580488 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1303 microversion: 2.1 time: 0.116158 Jul 20 17:53:22.706843 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 261/529] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:22 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:22.970033 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-bcfc75fe-fbe7-4f27-a440-4ff938c86ec9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:22.974591 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-bcfc75fe-fbe7-4f27-a440-4ff938c86ec9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1681 microversion: 2.1 time: 0.339330 Jul 20 17:53:22.975430 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 269/530] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:22 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1681 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:23.726227 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-72d2ac92-84db-42ee-8133-f6014b87ff83 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:23.727066 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-72d2ac92-84db-42ee-8133-f6014b87ff83 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:23.735952 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-72d2ac92-84db-42ee-8133-f6014b87ff83 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:23.737371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-72d2ac92-84db-42ee-8133-f6014b87ff83 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:23.738336 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-72d2ac92-84db-42ee-8133-f6014b87ff83 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:23.738954 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-72d2ac92-84db-42ee-8133-f6014b87ff83 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:23.889733 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-7730d9ad-bbfe-4e83-bd70-d90c4afbd6db req-a69f7d96-b349-486a-984e-15e1133155d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a959b594-9ce2-4fb1-b648-4016dfecb1b1", "name": "network-vif-deleted", "tag": "ea69bd29-73fa-4c45-8d4a-013f8382d993"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:23.905876 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-7730d9ad-bbfe-4e83-bd70-d90c4afbd6db req-a69f7d96-b349-486a-984e-15e1133155d8 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:23.907165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-7730d9ad-bbfe-4e83-bd70-d90c4afbd6db req-a69f7d96-b349-486a-984e-15e1133155d8 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:23.919431 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-7730d9ad-bbfe-4e83-bd70-d90c4afbd6db req-a69f7d96-b349-486a-984e-15e1133155d8 service nova] Creating event network-vif-deleted:ea69bd29-73fa-4c45-8d4a-013f8382d993 for instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 on hv-cinder-84984 Jul 20 17:53:23.925184 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-7730d9ad-bbfe-4e83-bd70-d90c4afbd6db req-a69f7d96-b349-486a-984e-15e1133155d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040361 Jul 20 17:53:23.926403 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 270/531] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:23.928416 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-72d2ac92-84db-42ee-8133-f6014b87ff83 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:23.938109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-72d2ac92-84db-42ee-8133-f6014b87ff83 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.217628 Jul 20 17:53:23.938758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 262/532] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:23 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:23.993409 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5c7cb6fb-d32a-48cc-923d-35b8ca69687d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:23.994097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5c7cb6fb-d32a-48cc-923d-35b8ca69687d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:24.001124 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5c7cb6fb-d32a-48cc-923d-35b8ca69687d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:24.001563 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5c7cb6fb-d32a-48cc-923d-35b8ca69687d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:24.002320 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5c7cb6fb-d32a-48cc-923d-35b8ca69687d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:24.003994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5c7cb6fb-d32a-48cc-923d-35b8ca69687d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:24.073795 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5c7cb6fb-d32a-48cc-923d-35b8ca69687d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:24.082510 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5c7cb6fb-d32a-48cc-923d-35b8ca69687d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1613 microversion: 2.1 time: 0.093817 Jul 20 17:53:24.083095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 271/533] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:23 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:24.956224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0971d1f6-09ba-4880-b68d-4eacc8c01441 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:24.956878 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0971d1f6-09ba-4880-b68d-4eacc8c01441 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:24.962605 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:24.964271 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0971d1f6-09ba-4880-b68d-4eacc8c01441 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:24.964749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0971d1f6-09ba-4880-b68d-4eacc8c01441 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:24.965531 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0971d1f6-09ba-4880-b68d-4eacc8c01441 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:24.966017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0971d1f6-09ba-4880-b68d-4eacc8c01441 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:24.970109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:25.101021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0f2d9f8d-c1f3-4ef3-8ac9-3e3e3980d386 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:25.101709 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0f2d9f8d-c1f3-4ef3-8ac9-3e3e3980d386 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:25.103824 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:25.104509 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=10 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:25.107811 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0971d1f6-09ba-4880-b68d-4eacc8c01441 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:25.110553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0f2d9f8d-c1f3-4ef3-8ac9-3e3e3980d386 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:25.111704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0f2d9f8d-c1f3-4ef3-8ac9-3e3e3980d386 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:25.112856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0f2d9f8d-c1f3-4ef3-8ac9-3e3e3980d386 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:25.113507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0f2d9f8d-c1f3-4ef3-8ac9-3e3e3980d386 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:25.116363 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0971d1f6-09ba-4880-b68d-4eacc8c01441 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.164556 Jul 20 17:53:25.117000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 263/534] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:24 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:25.181703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0f2d9f8d-c1f3-4ef3-8ac9-3e3e3980d386 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:25.190300 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0f2d9f8d-c1f3-4ef3-8ac9-3e3e3980d386 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1613 microversion: 2.1 time: 0.093464 Jul 20 17:53:25.190878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 272/535] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:25 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:26.136669 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5bf4fcac-43a4-4c64-8d0a-f8653356a479 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:26.137360 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5bf4fcac-43a4-4c64-8d0a-f8653356a479 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:26.144259 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5bf4fcac-43a4-4c64-8d0a-f8653356a479 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:26.145564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5bf4fcac-43a4-4c64-8d0a-f8653356a479 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:26.146678 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5bf4fcac-43a4-4c64-8d0a-f8653356a479 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:26.147205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5bf4fcac-43a4-4c64-8d0a-f8653356a479 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:26.207816 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:26.209367 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:26.216517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:26.217471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:26.218317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:26.218822 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:26.257401 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:26.257990 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:26.258701 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lazy-loading 'fault' on Instance uuid a959b594-9ce2-4fb1-b648-4016dfecb1b1 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:53:26.344060 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:26.352362 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-12c04b48-b415-4c72-a99d-2b70ae5ca035 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 200 len: 1330 microversion: 2.1 time: 0.148780 Jul 20 17:53:26.353112 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 273/536] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:26 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 1330 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:26.358958 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-990d4e71-bb62-48a0-942d-a7ce8245450d req-97edd07d-a6ed-4d00-8ea5-98cc732cd086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134b17e0-3dcb-4586-9810-065cd7ec4243", "tag": "3ed31386-5e58-4b1f-be48-e5bcbda66a7d"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:26.367118 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:26.369750 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-990d4e71-bb62-48a0-942d-a7ce8245450d req-97edd07d-a6ed-4d00-8ea5-98cc732cd086 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:26.370674 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-990d4e71-bb62-48a0-942d-a7ce8245450d req-97edd07d-a6ed-4d00-8ea5-98cc732cd086 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:26.383509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5bf4fcac-43a4-4c64-8d0a-f8653356a479 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:26.384143 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-990d4e71-bb62-48a0-942d-a7ce8245450d req-97edd07d-a6ed-4d00-8ea5-98cc732cd086 service nova] Creating event network-changed:3ed31386-5e58-4b1f-be48-e5bcbda66a7d for instance 134b17e0-3dcb-4586-9810-065cd7ec4243 on hv-cinder-84984 Jul 20 17:53:26.391599 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-990d4e71-bb62-48a0-942d-a7ce8245450d req-97edd07d-a6ed-4d00-8ea5-98cc732cd086 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036626 Jul 20 17:53:26.400221 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5bf4fcac-43a4-4c64-8d0a-f8653356a479 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.261056 Jul 20 17:53:26.400969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 274/537] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:26.401078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 264/538] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:26 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:26.798101 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-460559419", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "networks": [{"uuid": "76418757-051f-4c7d-9a32-4fe7635a563d"}]}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:26.851506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] validate_networks() for [('76418757-051f-4c7d-9a32-4fe7635a563d', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:53:27.371139 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:27.371932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:27.378515 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:27.379060 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:27.380017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:27.380595 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:27.394406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 HTTP/1.1 Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:53:27.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:53:27.397491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'a959b594-9ce2-4fb1-b648-4016dfecb1b1'} Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:53:27.398384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:53:27.399872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:53:27.401099 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:53:27.401099 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4be382f1-f828-4d65-a0bb-1879eb974a87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 404 len: 111 microversion: 2.1 time: 0.030157 Jul 20 17:53:27.401099 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 265/539] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:27 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 17:53:27.410988 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fb53631c-5cdf-492c-9e1b-d3f1693743d9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '.version_select at 0x7f7d3dea23a0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:27.498202 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fb53631c-5cdf-492c-9e1b-d3f1693743d9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625890755" status: 202 len: 0 microversion: 2.1 time: 0.091434 Jul 20 17:53:27.498786 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 266/540] 10.222.0.42 () {58 vars in 1217 bytes} [Wed Jul 20 17:53:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625890755 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 17:53:27.503438 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0d5d5241-7df4-413a-b4d9-eb967f97e5e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:27.504053 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0d5d5241-7df4-413a-b4d9-eb967f97e5e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:27.511120 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0d5d5241-7df4-413a-b4d9-eb967f97e5e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:27.511655 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0d5d5241-7df4-413a-b4d9-eb967f97e5e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:27.513162 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0d5d5241-7df4-413a-b4d9-eb967f97e5e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:27.513601 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0d5d5241-7df4-413a-b4d9-eb967f97e5e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:27.911572 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:53:27.912084 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:53:27.912730 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:53:27.913246 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:53:27.913796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:53:27.925043 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:27.925788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:27.926696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:27.927407 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:27.947850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Getting quotas for project 10e93d9f177d4ed5bba338ba68547bf7. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:53:27.949862 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Getting quotas for user 2bc0d03b364946a5b8af3db4e9fd4780 and project 10e93d9f177d4ed5bba338ba68547bf7. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:53:27.962676 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:53:27.965189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:53:28.029059 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0d5d5241-7df4-413a-b4d9-eb967f97e5e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:28.039167 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0d5d5241-7df4-413a-b4d9-eb967f97e5e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.539340 Jul 20 17:53:28.048479 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 267/541] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:27 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:28.212830 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a9e4b0a2-ee23-4447-ab00-5127d37aadd5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420033 Jul 20 17:53:28.213647 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 275/542] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 17:53:28.224027 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e03adf33-a275-4a0e-ba4b-6df30ac83be4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:28.224755 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e03adf33-a275-4a0e-ba4b-6df30ac83be4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:28.284341 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e03adf33-a275-4a0e-ba4b-6df30ac83be4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:28.298302 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e03adf33-a275-4a0e-ba4b-6df30ac83be4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1218 microversion: 2.1 time: 0.077425 Jul 20 17:53:28.299437 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 268/543] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:28 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:28.445091 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-48169592-459d-4295-ab50-74e441f24506 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:28.445583 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-48169592-459d-4295-ab50-74e441f24506 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:28.452617 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-48169592-459d-4295-ab50-74e441f24506 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:28.453110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-48169592-459d-4295-ab50-74e441f24506 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:28.453960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-48169592-459d-4295-ab50-74e441f24506 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:28.454435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-48169592-459d-4295-ab50-74e441f24506 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:28.580062 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-48169592-459d-4295-ab50-74e441f24506 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lazy-loading 'services' on Instance uuid b8a9d731-6fac-4e62-a247-194eb02970a2 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:53:28.832802 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-48169592-459d-4295-ab50-74e441f24506 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments/b4156de1-64f7-43f7-9d38-984b3c9508e4" status: 202 len: 0 microversion: 2.1 time: 0.391918 Jul 20 17:53:28.833503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 276/544] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:53:28 2022] DELETE /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments/b4156de1-64f7-43f7-9d38-984b3c9508e4 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:53:28.841943 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7a918cab-8091-42b5-b355-84f8117d1950 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:28.842856 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7a918cab-8091-42b5-b355-84f8117d1950 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:28.848841 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a918cab-8091-42b5-b355-84f8117d1950 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:28.849285 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a918cab-8091-42b5-b355-84f8117d1950 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:28.850037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a918cab-8091-42b5-b355-84f8117d1950 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:28.850464 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a918cab-8091-42b5-b355-84f8117d1950 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:28.879589 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7a918cab-8091-42b5-b355-84f8117d1950 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041652 Jul 20 17:53:28.880135 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 269/545] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:53:28 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:29.056798 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-97165a93-f849-4dfb-bfed-a6c397eea409 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:29.057544 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-97165a93-f849-4dfb-bfed-a6c397eea409 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:29.064567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-97165a93-f849-4dfb-bfed-a6c397eea409 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:29.065022 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-97165a93-f849-4dfb-bfed-a6c397eea409 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:29.065784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-97165a93-f849-4dfb-bfed-a6c397eea409 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:29.066220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-97165a93-f849-4dfb-bfed-a6c397eea409 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:29.199966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-97165a93-f849-4dfb-bfed-a6c397eea409 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:29.207507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-97165a93-f849-4dfb-bfed-a6c397eea409 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.155151 Jul 20 17:53:29.208080 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 277/546] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:29 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:29.319072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2592b5c6-d3f3-42b6-9f27-bab8c03d1a29 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:29.319723 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2592b5c6-d3f3-42b6-9f27-bab8c03d1a29 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:29.325706 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2592b5c6-d3f3-42b6-9f27-bab8c03d1a29 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:29.326153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2592b5c6-d3f3-42b6-9f27-bab8c03d1a29 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:29.326912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2592b5c6-d3f3-42b6-9f27-bab8c03d1a29 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:29.327347 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2592b5c6-d3f3-42b6-9f27-bab8c03d1a29 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:29.386669 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2592b5c6-d3f3-42b6-9f27-bab8c03d1a29 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:29.394014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2592b5c6-d3f3-42b6-9f27-bab8c03d1a29 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1222 microversion: 2.1 time: 0.078839 Jul 20 17:53:29.394572 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 270/547] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:29 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:29.891364 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9ad24148-d38b-4960-95f6-06418115fe7d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:29.892271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9ad24148-d38b-4960-95f6-06418115fe7d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:29.898772 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ad24148-d38b-4960-95f6-06418115fe7d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:29.899224 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ad24148-d38b-4960-95f6-06418115fe7d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:29.902640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ad24148-d38b-4960-95f6-06418115fe7d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:29.902640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ad24148-d38b-4960-95f6-06418115fe7d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:29.930627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9ad24148-d38b-4960-95f6-06418115fe7d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043364 Jul 20 17:53:29.931190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 278/548] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:53:29 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:30.224873 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-10eb9836-4741-4a65-b2d1-8c19f1e6b43f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:30.225487 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-10eb9836-4741-4a65-b2d1-8c19f1e6b43f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:30.231898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-10eb9836-4741-4a65-b2d1-8c19f1e6b43f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:30.232346 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-10eb9836-4741-4a65-b2d1-8c19f1e6b43f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:30.233160 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-10eb9836-4741-4a65-b2d1-8c19f1e6b43f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:30.233595 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-10eb9836-4741-4a65-b2d1-8c19f1e6b43f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:30.362124 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-10eb9836-4741-4a65-b2d1-8c19f1e6b43f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:30.369423 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-10eb9836-4741-4a65-b2d1-8c19f1e6b43f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.148439 Jul 20 17:53:30.369976 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 271/549] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:30 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:30.411021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8f7ec576-5f50-4da6-9829-3be3ef507b67 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:30.411788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8f7ec576-5f50-4da6-9829-3be3ef507b67 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:30.417958 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8f7ec576-5f50-4da6-9829-3be3ef507b67 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:30.418405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8f7ec576-5f50-4da6-9829-3be3ef507b67 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:30.419166 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8f7ec576-5f50-4da6-9829-3be3ef507b67 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:30.419600 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8f7ec576-5f50-4da6-9829-3be3ef507b67 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:30.483721 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8f7ec576-5f50-4da6-9829-3be3ef507b67 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:30.491223 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8f7ec576-5f50-4da6-9829-3be3ef507b67 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1214 microversion: 2.1 time: 0.084044 Jul 20 17:53:30.491784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 279/550] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:30 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:30.941996 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2e5b6877-91d4-4369-b832-e63206884898 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:30.942970 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2e5b6877-91d4-4369-b832-e63206884898 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:30.949239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e5b6877-91d4-4369-b832-e63206884898 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:30.949686 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e5b6877-91d4-4369-b832-e63206884898 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:30.950512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e5b6877-91d4-4369-b832-e63206884898 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:30.950940 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2e5b6877-91d4-4369-b832-e63206884898 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:30.986197 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2e5b6877-91d4-4369-b832-e63206884898 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048277 Jul 20 17:53:30.987061 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 272/551] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:53:30 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:31.386518 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eb096931-92b5-4c69-acd1-d24e6119c085 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:31.389763 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-eb096931-92b5-4c69-acd1-d24e6119c085 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:31.394658 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb096931-92b5-4c69-acd1-d24e6119c085 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:31.395112 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb096931-92b5-4c69-acd1-d24e6119c085 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:31.395872 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb096931-92b5-4c69-acd1-d24e6119c085 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:31.396308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb096931-92b5-4c69-acd1-d24e6119c085 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:31.508424 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-77ebaa7a-5746-4b62-bb2c-bc83b4b162ce tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:31.509811 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-77ebaa7a-5746-4b62-bb2c-bc83b4b162ce tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:31.517466 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-77ebaa7a-5746-4b62-bb2c-bc83b4b162ce tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:31.517889 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-77ebaa7a-5746-4b62-bb2c-bc83b4b162ce tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:31.518657 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-77ebaa7a-5746-4b62-bb2c-bc83b4b162ce tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:31.519276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-77ebaa7a-5746-4b62-bb2c-bc83b4b162ce tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:31.604899 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-77ebaa7a-5746-4b62-bb2c-bc83b4b162ce tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:31.613077 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-77ebaa7a-5746-4b62-bb2c-bc83b4b162ce tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1288 microversion: 2.1 time: 0.108470 Jul 20 17:53:31.613730 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 273/552] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:31 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:31.617497 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-eb096931-92b5-4c69-acd1-d24e6119c085 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:31.626413 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-eb096931-92b5-4c69-acd1-d24e6119c085 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.243623 Jul 20 17:53:31.626919 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 280/553] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:31 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:32.000974 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-201608b4-ac53-43f1-9d68-162701a4166b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:32.001981 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-201608b4-ac53-43f1-9d68-162701a4166b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:32.008017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-201608b4-ac53-43f1-9d68-162701a4166b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.008488 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-201608b4-ac53-43f1-9d68-162701a4166b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.009248 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-201608b4-ac53-43f1-9d68-162701a4166b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.009676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-201608b4-ac53-43f1-9d68-162701a4166b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.038692 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-201608b4-ac53-43f1-9d68-162701a4166b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042226 Jul 20 17:53:32.039230 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 274/554] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:53:31 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 17:53:32.096720 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5e862895-7676-4dda-a5aa-0c39291e8e68 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:32.097468 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5e862895-7676-4dda-a5aa-0c39291e8e68 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:32.103555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e862895-7676-4dda-a5aa-0c39291e8e68 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.103998 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e862895-7676-4dda-a5aa-0c39291e8e68 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.104782 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e862895-7676-4dda-a5aa-0c39291e8e68 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.105203 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e862895-7676-4dda-a5aa-0c39291e8e68 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.132827 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5e862895-7676-4dda-a5aa-0c39291e8e68 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:53:32.547746 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5e862895-7676-4dda-a5aa-0c39291e8e68 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 204 len: 0 microversion: 2.1 time: 0.454427 Jul 20 17:53:32.548375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 281/555] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:53:32 2022] DELETE /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:53:32.556462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d52a900a-c98a-4402-9f81-307a0bc3c5df tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:32.558463 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d52a900a-c98a-4402-9f81-307a0bc3c5df tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:32.563579 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d52a900a-c98a-4402-9f81-307a0bc3c5df tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.564027 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d52a900a-c98a-4402-9f81-307a0bc3c5df tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.564822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d52a900a-c98a-4402-9f81-307a0bc3c5df tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.565261 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d52a900a-c98a-4402-9f81-307a0bc3c5df tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.631776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d8892b9b-eb84-4d1c-ba83-acbb341121b4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:32.632535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d8892b9b-eb84-4d1c-ba83-acbb341121b4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:32.639115 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d8892b9b-eb84-4d1c-ba83-acbb341121b4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.639564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d8892b9b-eb84-4d1c-ba83-acbb341121b4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.640322 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d8892b9b-eb84-4d1c-ba83-acbb341121b4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.640785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d8892b9b-eb84-4d1c-ba83-acbb341121b4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.814450 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d52a900a-c98a-4402-9f81-307a0bc3c5df tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:32.821981 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d52a900a-c98a-4402-9f81-307a0bc3c5df tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1681 microversion: 2.1 time: 0.269314 Jul 20 17:53:32.822553 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 275/556] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:32 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1681 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:32.832425 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9d909885-15a0-4194-a236-bb1091d7e643 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:32.832425 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9d909885-15a0-4194-a236-bb1091d7e643 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:32.833964 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d909885-15a0-4194-a236-bb1091d7e643 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.834407 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d909885-15a0-4194-a236-bb1091d7e643 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.835158 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d909885-15a0-4194-a236-bb1091d7e643 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:32.835590 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9d909885-15a0-4194-a236-bb1091d7e643 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:32.918106 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d8892b9b-eb84-4d1c-ba83-acbb341121b4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:32.925916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d8892b9b-eb84-4d1c-ba83-acbb341121b4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.298403 Jul 20 17:53:32.926587 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 282/557] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:32 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:33.008199 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9d909885-15a0-4194-a236-bb1091d7e643 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:33.016149 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9d909885-15a0-4194-a236-bb1091d7e643 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.192647 Jul 20 17:53:33.023386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 276/558] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:32 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:33.375887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-bb9dba8e-10b9-4e74-9b01-f462d0c9a5df req-a5679012-f4fc-4060-96cc-4780233fc05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d909f9f-c728-4099-9e85-5d49e43f2652", "tag": "72a5820f-822f-4734-b30d-285c899befc6"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:33.383871 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-bb9dba8e-10b9-4e74-9b01-f462d0c9a5df req-a5679012-f4fc-4060-96cc-4780233fc05b service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:33.384308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-bb9dba8e-10b9-4e74-9b01-f462d0c9a5df req-a5679012-f4fc-4060-96cc-4780233fc05b service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:33.395737 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-bb9dba8e-10b9-4e74-9b01-f462d0c9a5df req-a5679012-f4fc-4060-96cc-4780233fc05b service nova] Creating event network-changed:72a5820f-822f-4734-b30d-285c899befc6 for instance 9d909f9f-c728-4099-9e85-5d49e43f2652 on hv-cinder-84984 Jul 20 17:53:33.400015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-bb9dba8e-10b9-4e74-9b01-f462d0c9a5df req-a5679012-f4fc-4060-96cc-4780233fc05b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028279 Jul 20 17:53:33.400660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 283/559] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:53:33.824976 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-f7d82f5d-7685-42c0-baae-0f4add4a961d req-62d76056-b99e-4a9b-b6cd-f7b89e3818b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134b17e0-3dcb-4586-9810-065cd7ec4243", "name": "network-vif-plugged", "status": "completed", "tag": "3ed31386-5e58-4b1f-be48-e5bcbda66a7d"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:33.828114 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f7d82f5d-7685-42c0-baae-0f4add4a961d req-62d76056-b99e-4a9b-b6cd-f7b89e3818b0 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:33.828596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f7d82f5d-7685-42c0-baae-0f4add4a961d req-62d76056-b99e-4a9b-b6cd-f7b89e3818b0 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:33.839544 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5ffcfe14-b15d-4522-915e-670be9b42640 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:33.840028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-f7d82f5d-7685-42c0-baae-0f4add4a961d req-62d76056-b99e-4a9b-b6cd-f7b89e3818b0 service nova] Creating event network-vif-plugged:3ed31386-5e58-4b1f-be48-e5bcbda66a7d for instance 134b17e0-3dcb-4586-9810-065cd7ec4243 on hv-cinder-84984 Jul 20 17:53:33.840252 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5ffcfe14-b15d-4522-915e-670be9b42640 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:33.845507 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-f7d82f5d-7685-42c0-baae-0f4add4a961d req-62d76056-b99e-4a9b-b6cd-f7b89e3818b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029892 Jul 20 17:53:33.846110 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 277/560] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:53:33.847326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ffcfe14-b15d-4522-915e-670be9b42640 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:33.847873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ffcfe14-b15d-4522-915e-670be9b42640 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:33.848687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ffcfe14-b15d-4522-915e-670be9b42640 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:33.849143 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ffcfe14-b15d-4522-915e-670be9b42640 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:33.867574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:33.943904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e7654cdb-865f-45e8-82b9-d078aa89d73b tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:33.944659 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e7654cdb-865f-45e8-82b9-d078aa89d73b tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:33.951637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7654cdb-865f-45e8-82b9-d078aa89d73b tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:33.952093 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7654cdb-865f-45e8-82b9-d078aa89d73b tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:33.952931 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7654cdb-865f-45e8-82b9-d078aa89d73b tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:33.953486 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7654cdb-865f-45e8-82b9-d078aa89d73b tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:33.985632 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5ffcfe14-b15d-4522-915e-670be9b42640 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:33.997306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5ffcfe14-b15d-4522-915e-670be9b42640 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1681 microversion: 2.1 time: 0.158687 Jul 20 17:53:33.997306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 284/561] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:33 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:34.033319 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a7bd15e9-34cd-4a49-851a-b1aa1e56df42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:34.033910 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a7bd15e9-34cd-4a49-851a-b1aa1e56df42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:34.039855 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a7bd15e9-34cd-4a49-851a-b1aa1e56df42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:34.040303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a7bd15e9-34cd-4a49-851a-b1aa1e56df42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:34.041103 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a7bd15e9-34cd-4a49-851a-b1aa1e56df42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:34.041534 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a7bd15e9-34cd-4a49-851a-b1aa1e56df42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:34.113396 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e7654cdb-865f-45e8-82b9-d078aa89d73b tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:34.120937 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e7654cdb-865f-45e8-82b9-d078aa89d73b tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.181124 Jul 20 17:53:34.121509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 278/562] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:33 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:34.185408 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a7bd15e9-34cd-4a49-851a-b1aa1e56df42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:34.193140 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a7bd15e9-34cd-4a49-851a-b1aa1e56df42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.163690 Jul 20 17:53:34.197319 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 285/563] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:34 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:35.011254 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-64f188f9-bbd5-4344-abee-714c6753a62b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:35.011813 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-64f188f9-bbd5-4344-abee-714c6753a62b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:35.018328 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64f188f9-bbd5-4344-abee-714c6753a62b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:35.018880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64f188f9-bbd5-4344-abee-714c6753a62b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:35.019525 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64f188f9-bbd5-4344-abee-714c6753a62b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:35.019961 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64f188f9-bbd5-4344-abee-714c6753a62b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:35.137794 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1321b783-f0f7-4908-8d2c-b970b64c15f4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:35.138403 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1321b783-f0f7-4908-8d2c-b970b64c15f4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:35.145117 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1321b783-f0f7-4908-8d2c-b970b64c15f4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:35.146561 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1321b783-f0f7-4908-8d2c-b970b64c15f4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:35.147656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1321b783-f0f7-4908-8d2c-b970b64c15f4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:35.148110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1321b783-f0f7-4908-8d2c-b970b64c15f4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:35.173103 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-64f188f9-bbd5-4344-abee-714c6753a62b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:35.181299 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-64f188f9-bbd5-4344-abee-714c6753a62b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1681 microversion: 2.1 time: 0.174027 Jul 20 17:53:35.181879 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 279/564] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:35 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:35.210564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0f0c3799-c50a-42b9-9fd1-2f8d8dd75823 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:35.211175 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0f0c3799-c50a-42b9-9fd1-2f8d8dd75823 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:35.217463 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f0c3799-c50a-42b9-9fd1-2f8d8dd75823 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:35.217919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f0c3799-c50a-42b9-9fd1-2f8d8dd75823 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:35.218715 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f0c3799-c50a-42b9-9fd1-2f8d8dd75823 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:35.219157 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f0c3799-c50a-42b9-9fd1-2f8d8dd75823 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:35.329785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1321b783-f0f7-4908-8d2c-b970b64c15f4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:35.337150 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1321b783-f0f7-4908-8d2c-b970b64c15f4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.203230 Jul 20 17:53:35.340592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 286/565] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:35 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:35.374056 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0f0c3799-c50a-42b9-9fd1-2f8d8dd75823 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:35.381504 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0f0c3799-c50a-42b9-9fd1-2f8d8dd75823 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.174812 Jul 20 17:53:35.382071 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 280/566] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:35 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:35.546854 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-acdf8f46-36f0-4057-b5f4-0c16eba45c13 req-aaa61a3a-3e30-4d15-b927-b4ad74acb0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a9d731-6fac-4e62-a247-194eb02970a2", "name": "network-vif-deleted", "tag": "b4d1a842-ac4e-4cea-b6c2-edcf4932e3d1"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:35.555097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-acdf8f46-36f0-4057-b5f4-0c16eba45c13 req-aaa61a3a-3e30-4d15-b927-b4ad74acb0e9 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:35.555471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-acdf8f46-36f0-4057-b5f4-0c16eba45c13 req-aaa61a3a-3e30-4d15-b927-b4ad74acb0e9 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:35.567566 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-acdf8f46-36f0-4057-b5f4-0c16eba45c13 req-aaa61a3a-3e30-4d15-b927-b4ad74acb0e9 service nova] Creating event network-vif-deleted:b4d1a842-ac4e-4cea-b6c2-edcf4932e3d1 for instance b8a9d731-6fac-4e62-a247-194eb02970a2 on hv-cinder-84984 Jul 20 17:53:35.572462 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-acdf8f46-36f0-4057-b5f4-0c16eba45c13 req-aaa61a3a-3e30-4d15-b927-b4ad74acb0e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029896 Jul 20 17:53:35.573347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 287/567] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:36.201789 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:36.201789 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:36.206558 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.207017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.207795 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.208229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.242693 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.243148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.243652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lazy-loading 'fault' on Instance uuid b8a9d731-6fac-4e62-a247-194eb02970a2 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:53:36.288661 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:36.296885 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8bf22f6c-af34-40e1-b438-879ff5b53cd9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1331 microversion: 2.1 time: 0.101557 Jul 20 17:53:36.297461 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 281/568] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:36 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:36.320631 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-14a9fdb4-50dd-4aab-86ee-78281770f5c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:36.321732 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-14a9fdb4-50dd-4aab-86ee-78281770f5c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:36.329208 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-14a9fdb4-50dd-4aab-86ee-78281770f5c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.329667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-14a9fdb4-50dd-4aab-86ee-78281770f5c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.330448 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-14a9fdb4-50dd-4aab-86ee-78281770f5c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.330887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-14a9fdb4-50dd-4aab-86ee-78281770f5c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.356413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-042fe7ef-8078-4e38-b79d-3516ea770fad tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:36.357460 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-042fe7ef-8078-4e38-b79d-3516ea770fad tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:36.364105 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-042fe7ef-8078-4e38-b79d-3516ea770fad tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.364597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-042fe7ef-8078-4e38-b79d-3516ea770fad tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.365533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-042fe7ef-8078-4e38-b79d-3516ea770fad tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.365992 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-042fe7ef-8078-4e38-b79d-3516ea770fad tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.516648 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-042fe7ef-8078-4e38-b79d-3516ea770fad tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:36.519005 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:36.524952 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-042fe7ef-8078-4e38-b79d-3516ea770fad tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.175080 Jul 20 17:53:36.525513 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 282/569] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:36 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:36.530580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e2e0ab47-561f-4e5a-84db-b0a660235311 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:36.531197 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e2e0ab47-561f-4e5a-84db-b0a660235311 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:36.537030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e2e0ab47-561f-4e5a-84db-b0a660235311 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.537479 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e2e0ab47-561f-4e5a-84db-b0a660235311 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.538246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e2e0ab47-561f-4e5a-84db-b0a660235311 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.538682 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e2e0ab47-561f-4e5a-84db-b0a660235311 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.586629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-14a9fdb4-50dd-4aab-86ee-78281770f5c0 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "POST /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/action" status: 202 len: 0 microversion: 2.1 time: 0.271422 Jul 20 17:53:36.590940 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 288/570] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:53:36 2022] POST /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:53:36.597381 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-04865306-ad11-46dc-a936-2c2e67395be6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:36.602132 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-04865306-ad11-46dc-a936-2c2e67395be6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:36.613700 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-04865306-ad11-46dc-a936-2c2e67395be6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.614161 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-04865306-ad11-46dc-a936-2c2e67395be6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.614994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-04865306-ad11-46dc-a936-2c2e67395be6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:36.615468 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-04865306-ad11-46dc-a936-2c2e67395be6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:36.820768 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e2e0ab47-561f-4e5a-84db-b0a660235311 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:36.828824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e2e0ab47-561f-4e5a-84db-b0a660235311 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1371 microversion: 2.1 time: 0.302332 Jul 20 17:53:36.829387 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 283/571] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:36 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:36.838567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-04865306-ad11-46dc-a936-2c2e67395be6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:36.844716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-04865306-ad11-46dc-a936-2c2e67395be6 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1750 microversion: 2.1 time: 0.251515 Jul 20 17:53:36.845283 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 289/572] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:36 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1750 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:37.314458 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:37.315063 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:37.321418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:37.321865 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:37.322621 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:37.323093 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:37.353516 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:37.353957 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:37.357914 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lazy-loading 'fault' on Instance uuid b8a9d731-6fac-4e62-a247-194eb02970a2 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:53:37.395094 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:37.402529 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-78d07268-5134-44dd-a4f0-6b8af3a41b6a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 200 len: 1331 microversion: 2.1 time: 0.092984 Jul 20 17:53:37.403618 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 284/573] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:37 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:37.542019 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-523b950b-dd1f-46d9-9219-2bbc66c9bfff tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:37.542593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-523b950b-dd1f-46d9-9219-2bbc66c9bfff tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:37.549703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-523b950b-dd1f-46d9-9219-2bbc66c9bfff tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:37.550145 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-523b950b-dd1f-46d9-9219-2bbc66c9bfff tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:37.550894 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-523b950b-dd1f-46d9-9219-2bbc66c9bfff tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:37.551324 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-523b950b-dd1f-46d9-9219-2bbc66c9bfff tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:37.681053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-523b950b-dd1f-46d9-9219-2bbc66c9bfff tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:37.688690 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-523b950b-dd1f-46d9-9219-2bbc66c9bfff tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.150548 Jul 20 17:53:37.689253 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 290/574] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:37 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:37.846875 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d0cf26d6-ff5b-434c-9f61-dc65e17b8602 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:37.847405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d0cf26d6-ff5b-434c-9f61-dc65e17b8602 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:37.853512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d0cf26d6-ff5b-434c-9f61-dc65e17b8602 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:37.853968 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d0cf26d6-ff5b-434c-9f61-dc65e17b8602 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:37.854722 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d0cf26d6-ff5b-434c-9f61-dc65e17b8602 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:37.855161 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d0cf26d6-ff5b-434c-9f61-dc65e17b8602 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:37.861453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f994104c-264e-4907-8b3c-de038daa1091 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:37.862068 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f994104c-264e-4907-8b3c-de038daa1091 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:37.867929 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f994104c-264e-4907-8b3c-de038daa1091 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:37.868389 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f994104c-264e-4907-8b3c-de038daa1091 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:37.869198 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f994104c-264e-4907-8b3c-de038daa1091 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:37.869641 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f994104c-264e-4907-8b3c-de038daa1091 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:37.936426 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:37.958883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=6 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:38.067719 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d0cf26d6-ff5b-434c-9f61-dc65e17b8602 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:38.075183 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d0cf26d6-ff5b-434c-9f61-dc65e17b8602 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1564 microversion: 2.1 time: 0.232194 Jul 20 17:53:38.075760 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 285/575] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:37 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1564 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:38.091786 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0c8d97b0-3ac2-4a4e-b6dd-93d3097d9a1d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:38.092277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0c8d97b0-3ac2-4a4e-b6dd-93d3097d9a1d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:38.098658 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c8d97b0-3ac2-4a4e-b6dd-93d3097d9a1d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:38.099127 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f994104c-264e-4907-8b3c-de038daa1091 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:38.099329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c8d97b0-3ac2-4a4e-b6dd-93d3097d9a1d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:38.101994 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c8d97b0-3ac2-4a4e-b6dd-93d3097d9a1d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:38.102691 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c8d97b0-3ac2-4a4e-b6dd-93d3097d9a1d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:38.111069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f994104c-264e-4907-8b3c-de038daa1091 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1750 microversion: 2.1 time: 0.253382 Jul 20 17:53:38.112054 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 291/576] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:37 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1750 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:38.197854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0c8d97b0-3ac2-4a4e-b6dd-93d3097d9a1d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109738 Jul 20 17:53:38.198453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 286/577] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jul 20 17:53:38 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:53:38.421156 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:38.421988 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:38.428038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:38.428513 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:38.429297 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:38.429736 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:38.444060 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 HTTP/1.1 Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:53:38.447281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:53:38.448680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'b8a9d731-6fac-4e62-a247-194eb02970a2'} Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:53:38.449435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:53:38.451227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:53:38.452380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:53:38.452380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-71ae4291-b41b-4856-a1eb-5a65322dccb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 404 len: 111 microversion: 2.1 time: 0.031279 Jul 20 17:53:38.452380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 292/578] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:38 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:53:38.456284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d1d24df1-0d9c-4565-a7ad-89b0bdc66554 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '.version_select at 0x7f7d3deb7160>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:38.459788 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:38.526767 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d1d24df1-0d9c-4565-a7ad-89b0bdc66554 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053466132" status: 202 len: 0 microversion: 2.1 time: 0.074132 Jul 20 17:53:38.527473 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 287/579] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jul 20 17:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053466132 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:53:38.706090 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5253f323-b97a-432b-bc87-947451d119d2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:38.706713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5253f323-b97a-432b-bc87-947451d119d2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:38.713289 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5253f323-b97a-432b-bc87-947451d119d2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:38.713742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5253f323-b97a-432b-bc87-947451d119d2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:38.714507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5253f323-b97a-432b-bc87-947451d119d2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:38.714941 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5253f323-b97a-432b-bc87-947451d119d2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:38.847146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5253f323-b97a-432b-bc87-947451d119d2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:38.854851 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5253f323-b97a-432b-bc87-947451d119d2 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.152680 Jul 20 17:53:38.858896 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 293/580] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:38 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:39.131665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3e31b94f-84cf-411f-885b-f7742a291fd8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:39.132323 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3e31b94f-84cf-411f-885b-f7742a291fd8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:39.139167 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e31b94f-84cf-411f-885b-f7742a291fd8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:39.141394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e31b94f-84cf-411f-885b-f7742a291fd8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:39.141394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e31b94f-84cf-411f-885b-f7742a291fd8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:39.141394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3e31b94f-84cf-411f-885b-f7742a291fd8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:39.307955 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-db0f3d56-4a77-44bb-8e8a-cf1ac03582fb req-5f09e6f1-9ad0-45c8-a670-f298f141da8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134b17e0-3dcb-4586-9810-065cd7ec4243", "tag": "3ed31386-5e58-4b1f-be48-e5bcbda66a7d"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:39.318491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-db0f3d56-4a77-44bb-8e8a-cf1ac03582fb req-5f09e6f1-9ad0-45c8-a670-f298f141da8d service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:39.318491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-db0f3d56-4a77-44bb-8e8a-cf1ac03582fb req-5f09e6f1-9ad0-45c8-a670-f298f141da8d service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:39.329998 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-db0f3d56-4a77-44bb-8e8a-cf1ac03582fb req-5f09e6f1-9ad0-45c8-a670-f298f141da8d service nova] Creating event network-changed:3ed31386-5e58-4b1f-be48-e5bcbda66a7d for instance 134b17e0-3dcb-4586-9810-065cd7ec4243 on hv-cinder-84984 Jul 20 17:53:39.335304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-db0f3d56-4a77-44bb-8e8a-cf1ac03582fb req-5f09e6f1-9ad0-45c8-a670-f298f141da8d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030951 Jul 20 17:53:39.336637 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 294/581] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:53:39.347386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3e31b94f-84cf-411f-885b-f7742a291fd8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:39.355970 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3e31b94f-84cf-411f-885b-f7742a291fd8 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.228375 Jul 20 17:53:39.359229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 288/582] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:39 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:39.850495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-aac126b8-fdfa-4ce0-aa55-9f7fe5f7d81c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: .version_select at 0x7f7d3d80c790>, body: {"keypair": {"name": "tempest-keypair-1796327026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcX20CaADHMqPr7BecjO6UxCb4aQJ9kGuyezQIKHxLdxb3IuwLDNtvwsFaEQ/j7keiCJbcEoU87Qd/Z8rrHHJR2NGoXORHi6pvw9uTaxH7bMFBYrPJGqQw5z9OKOpZEbg=="}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:39.866017 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-aac126b8-fdfa-4ce0-aa55-9f7fe5f7d81c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for project 93918dc6b6f445d18a3ecb003524152d. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:53:39.872592 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ef5d58cb-8f7d-49c7-b64b-3b790b957062 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:39.873206 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ef5d58cb-8f7d-49c7-b64b-3b790b957062 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:39.880715 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ef5d58cb-8f7d-49c7-b64b-3b790b957062 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:39.881167 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ef5d58cb-8f7d-49c7-b64b-3b790b957062 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:39.881939 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ef5d58cb-8f7d-49c7-b64b-3b790b957062 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:39.882374 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ef5d58cb-8f7d-49c7-b64b-3b790b957062 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:39.889277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-aac126b8-fdfa-4ce0-aa55-9f7fe5f7d81c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for user 3077a7934f9c4407a70a8790b8da9cde and project 93918dc6b6f445d18a3ecb003524152d. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:53:39.985578 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-aac126b8-fdfa-4ce0-aa55-9f7fe5f7d81c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139240 Jul 20 17:53:39.991835 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 295/583] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 17:53:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:40.133309 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ef5d58cb-8f7d-49c7-b64b-3b790b957062 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:40.143583 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ef5d58cb-8f7d-49c7-b64b-3b790b957062 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.275214 Jul 20 17:53:40.153821 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 289/584] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:39 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:40.374971 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ab51e1a7-d42b-47c6-a7d6-aee10c06ac04 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:40.375815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ab51e1a7-d42b-47c6-a7d6-aee10c06ac04 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:40.382784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab51e1a7-d42b-47c6-a7d6-aee10c06ac04 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:40.383247 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab51e1a7-d42b-47c6-a7d6-aee10c06ac04 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:40.384233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab51e1a7-d42b-47c6-a7d6-aee10c06ac04 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:40.384494 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab51e1a7-d42b-47c6-a7d6-aee10c06ac04 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:40.549597 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ab51e1a7-d42b-47c6-a7d6-aee10c06ac04 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:40.557625 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ab51e1a7-d42b-47c6-a7d6-aee10c06ac04 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.187469 Jul 20 17:53:40.561884 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 296/585] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:40 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:41.160286 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0b8a48d6-b3a3-4cf5-a292-3d3671df6ed1 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:41.160935 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0b8a48d6-b3a3-4cf5-a292-3d3671df6ed1 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:41.163251 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:41.167959 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b8a48d6-b3a3-4cf5-a292-3d3671df6ed1 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:41.168402 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b8a48d6-b3a3-4cf5-a292-3d3671df6ed1 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:41.169767 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b8a48d6-b3a3-4cf5-a292-3d3671df6ed1 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:41.170198 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b8a48d6-b3a3-4cf5-a292-3d3671df6ed1 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:41.301953 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0b8a48d6-b3a3-4cf5-a292-3d3671df6ed1 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:41.309967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0b8a48d6-b3a3-4cf5-a292-3d3671df6ed1 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.153546 Jul 20 17:53:41.310758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 290/586] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:41 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:41.575300 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f3abbcf9-718b-42f5-b238-ccd5027156a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:41.576552 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f3abbcf9-718b-42f5-b238-ccd5027156a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:41.583075 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3abbcf9-718b-42f5-b238-ccd5027156a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:41.583527 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3abbcf9-718b-42f5-b238-ccd5027156a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:41.584315 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3abbcf9-718b-42f5-b238-ccd5027156a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:41.584774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3abbcf9-718b-42f5-b238-ccd5027156a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:41.741948 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f3abbcf9-718b-42f5-b238-ccd5027156a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:41.755920 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f3abbcf9-718b-42f5-b238-ccd5027156a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.179837 Jul 20 17:53:41.755920 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 297/587] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:41 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:42.327624 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6240bca5-eb62-4f50-afdb-898204d009b6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:42.330019 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6240bca5-eb62-4f50-afdb-898204d009b6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:42.334701 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6240bca5-eb62-4f50-afdb-898204d009b6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:42.335156 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6240bca5-eb62-4f50-afdb-898204d009b6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:42.335926 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6240bca5-eb62-4f50-afdb-898204d009b6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:42.336364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6240bca5-eb62-4f50-afdb-898204d009b6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:42.480657 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6240bca5-eb62-4f50-afdb-898204d009b6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:42.488039 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6240bca5-eb62-4f50-afdb-898204d009b6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.164824 Jul 20 17:53:42.488642 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 291/588] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:42 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:42.597613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-678241789", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e772fe92-4472-4af3-b6e9-3d6e16e3740d"}], "security_groups": [{"name": "tempest-securitygroup--1939259638"}], "key_name": "tempest-keypair-1796327026", "user_data": "}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:42.697466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] validate_networks() for [('e772fe92-4472-4af3-b6e9-3d6e16e3740d', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:53:42.768807 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-51463a41-ac25-48d1-8e13-71f3a798158c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:42.769448 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-51463a41-ac25-48d1-8e13-71f3a798158c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:42.775399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51463a41-ac25-48d1-8e13-71f3a798158c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:42.775841 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51463a41-ac25-48d1-8e13-71f3a798158c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:42.776633 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51463a41-ac25-48d1-8e13-71f3a798158c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:42.777063 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51463a41-ac25-48d1-8e13-71f3a798158c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:42.979604 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-51463a41-ac25-48d1-8e13-71f3a798158c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:42.988342 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-51463a41-ac25-48d1-8e13-71f3a798158c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.223370 Jul 20 17:53:42.988944 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 292/589] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:42 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:43.133046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:53:43.133463 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:53:43.133927 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:53:43.134328 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:53:43.134737 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:53:43.144183 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:43.144855 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:43.145829 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:43.146458 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:43.163165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for project 93918dc6b6f445d18a3ecb003524152d. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:53:43.167114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for user 3077a7934f9c4407a70a8790b8da9cde and project 93918dc6b6f445d18a3ecb003524152d. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:53:43.178459 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:53:43.180726 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:53:43.321090 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ab05ae29-d2a3-4cdd-b771-76221b2b463d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.727770 Jul 20 17:53:43.321740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 298/590] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:53:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:53:43.331823 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-010177ca-d9b8-4fa5-b1c0-dfe4d0bc7a8b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:43.332453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-010177ca-d9b8-4fa5-b1c0-dfe4d0bc7a8b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:43.386676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-010177ca-d9b8-4fa5-b1c0-dfe4d0bc7a8b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:43.393451 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-010177ca-d9b8-4fa5-b1c0-dfe4d0bc7a8b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1241 microversion: 2.1 time: 0.065455 Jul 20 17:53:43.394026 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 293/591] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:43 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:43.505558 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5c5eb4bb-2b0e-44b3-9880-bc65423ae0e4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:43.506229 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5c5eb4bb-2b0e-44b3-9880-bc65423ae0e4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:43.512797 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5c5eb4bb-2b0e-44b3-9880-bc65423ae0e4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:43.513287 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5c5eb4bb-2b0e-44b3-9880-bc65423ae0e4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:43.514069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5c5eb4bb-2b0e-44b3-9880-bc65423ae0e4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:43.514504 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5c5eb4bb-2b0e-44b3-9880-bc65423ae0e4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:43.646506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5c5eb4bb-2b0e-44b3-9880-bc65423ae0e4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:43.655939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5c5eb4bb-2b0e-44b3-9880-bc65423ae0e4 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.154280 Jul 20 17:53:43.656852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 299/592] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:43 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:43.871794 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-78010554-34ff-464b-a720-6196ae23ec2b req-fa2f5208-2ea8-4049-9c07-65b5b3d5e770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d909f9f-c728-4099-9e85-5d49e43f2652", "name": "network-vif-plugged", "status": "completed", "tag": "72a5820f-822f-4734-b30d-285c899befc6"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:43.889626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-78010554-34ff-464b-a720-6196ae23ec2b req-fa2f5208-2ea8-4049-9c07-65b5b3d5e770 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:43.890055 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-78010554-34ff-464b-a720-6196ae23ec2b req-fa2f5208-2ea8-4049-9c07-65b5b3d5e770 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:43.901139 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-78010554-34ff-464b-a720-6196ae23ec2b req-fa2f5208-2ea8-4049-9c07-65b5b3d5e770 service nova] Creating event network-vif-plugged:72a5820f-822f-4734-b30d-285c899befc6 for instance 9d909f9f-c728-4099-9e85-5d49e43f2652 on hv-cinder-84984 Jul 20 17:53:43.906521 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-78010554-34ff-464b-a720-6196ae23ec2b req-fa2f5208-2ea8-4049-9c07-65b5b3d5e770 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038781 Jul 20 17:53:43.907114 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 294/593] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:53:44.006516 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3654e454-afee-4dc5-a8d5-5df5dd19d0b3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:44.006827 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3654e454-afee-4dc5-a8d5-5df5dd19d0b3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:44.013852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3654e454-afee-4dc5-a8d5-5df5dd19d0b3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:44.014424 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3654e454-afee-4dc5-a8d5-5df5dd19d0b3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:44.015319 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3654e454-afee-4dc5-a8d5-5df5dd19d0b3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:44.015838 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3654e454-afee-4dc5-a8d5-5df5dd19d0b3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:44.170535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3654e454-afee-4dc5-a8d5-5df5dd19d0b3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:44.178770 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3654e454-afee-4dc5-a8d5-5df5dd19d0b3 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.176689 Jul 20 17:53:44.179352 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 300/594] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:44 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:44.411688 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4451ea33-0aad-4480-9b51-9cb6ad8e10e3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:44.412378 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4451ea33-0aad-4480-9b51-9cb6ad8e10e3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:44.420078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4451ea33-0aad-4480-9b51-9cb6ad8e10e3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:44.420488 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4451ea33-0aad-4480-9b51-9cb6ad8e10e3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:44.421242 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4451ea33-0aad-4480-9b51-9cb6ad8e10e3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:44.421670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4451ea33-0aad-4480-9b51-9cb6ad8e10e3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:44.487140 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4451ea33-0aad-4480-9b51-9cb6ad8e10e3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:44.494874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4451ea33-0aad-4480-9b51-9cb6ad8e10e3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1245 microversion: 2.1 time: 0.088107 Jul 20 17:53:44.496555 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 295/595] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:44 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:44.673081 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-dfbd15ca-2e54-4e59-9cc8-210c38eb8dc6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:44.673673 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-dfbd15ca-2e54-4e59-9cc8-210c38eb8dc6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:44.676001 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:44.680699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dfbd15ca-2e54-4e59-9cc8-210c38eb8dc6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:44.681142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dfbd15ca-2e54-4e59-9cc8-210c38eb8dc6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:44.681895 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dfbd15ca-2e54-4e59-9cc8-210c38eb8dc6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:44.682321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dfbd15ca-2e54-4e59-9cc8-210c38eb8dc6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:44.811402 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-dfbd15ca-2e54-4e59-9cc8-210c38eb8dc6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:44.818875 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-dfbd15ca-2e54-4e59-9cc8-210c38eb8dc6 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.149766 Jul 20 17:53:44.819444 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 301/596] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:44 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:45.195685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1d3f2204-de3b-48e3-812c-14eafa5b2d11 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:45.196297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1d3f2204-de3b-48e3-812c-14eafa5b2d11 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:45.202304 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1d3f2204-de3b-48e3-812c-14eafa5b2d11 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:45.202755 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1d3f2204-de3b-48e3-812c-14eafa5b2d11 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:45.203524 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1d3f2204-de3b-48e3-812c-14eafa5b2d11 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:45.203960 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1d3f2204-de3b-48e3-812c-14eafa5b2d11 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:45.347029 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-1d3f2204-de3b-48e3-812c-14eafa5b2d11 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:45.355244 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1d3f2204-de3b-48e3-812c-14eafa5b2d11 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.163489 Jul 20 17:53:45.355804 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 296/597] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:45 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:45.512021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-049b48ea-9f96-4910-8b99-fbbbc6629eb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:45.513229 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-049b48ea-9f96-4910-8b99-fbbbc6629eb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:45.519356 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-049b48ea-9f96-4910-8b99-fbbbc6629eb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:45.519802 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-049b48ea-9f96-4910-8b99-fbbbc6629eb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:45.520593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-049b48ea-9f96-4910-8b99-fbbbc6629eb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:45.521027 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-049b48ea-9f96-4910-8b99-fbbbc6629eb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:45.588674 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-049b48ea-9f96-4910-8b99-fbbbc6629eb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:45.596053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-049b48ea-9f96-4910-8b99-fbbbc6629eb3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1293 microversion: 2.1 time: 0.088253 Jul 20 17:53:45.596644 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 302/598] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:45 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:45.836822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e3ded7e2-a9d2-4340-bc9f-9f440a35bd27 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:45.837382 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e3ded7e2-a9d2-4340-bc9f-9f440a35bd27 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:45.843801 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e3ded7e2-a9d2-4340-bc9f-9f440a35bd27 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:45.844254 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e3ded7e2-a9d2-4340-bc9f-9f440a35bd27 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:45.845058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e3ded7e2-a9d2-4340-bc9f-9f440a35bd27 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:45.845500 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e3ded7e2-a9d2-4340-bc9f-9f440a35bd27 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:45.984681 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e3ded7e2-a9d2-4340-bc9f-9f440a35bd27 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:45.992545 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e3ded7e2-a9d2-4340-bc9f-9f440a35bd27 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1318 microversion: 2.1 time: 0.159644 Jul 20 17:53:45.993104 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 297/599] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:45 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:46.372626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-afbcec6c-7202-43d6-acfc-d1c97ed1a4fb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:46.373242 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-afbcec6c-7202-43d6-acfc-d1c97ed1a4fb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:46.379693 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-afbcec6c-7202-43d6-acfc-d1c97ed1a4fb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:46.380136 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-afbcec6c-7202-43d6-acfc-d1c97ed1a4fb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:46.380931 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-afbcec6c-7202-43d6-acfc-d1c97ed1a4fb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:46.381374 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-afbcec6c-7202-43d6-acfc-d1c97ed1a4fb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:46.522301 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-afbcec6c-7202-43d6-acfc-d1c97ed1a4fb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:46.525762 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:46.531183 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-afbcec6c-7202-43d6-acfc-d1c97ed1a4fb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.162472 Jul 20 17:53:46.531752 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 303/600] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:46 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:46.613625 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-99996d81-241e-4195-87bf-beda2eabddfe tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:46.614280 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-99996d81-241e-4195-87bf-beda2eabddfe tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:46.621652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99996d81-241e-4195-87bf-beda2eabddfe tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:46.622144 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99996d81-241e-4195-87bf-beda2eabddfe tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:46.622854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99996d81-241e-4195-87bf-beda2eabddfe tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:46.623314 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-99996d81-241e-4195-87bf-beda2eabddfe tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:46.726883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-99996d81-241e-4195-87bf-beda2eabddfe tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:46.734369 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-99996d81-241e-4195-87bf-beda2eabddfe tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1301 microversion: 2.1 time: 0.124938 Jul 20 17:53:46.734947 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 298/601] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:46 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1301 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:47.009845 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1a99b0d6-9dc3-4a55-9ab1-a9817db80734 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:47.010481 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1a99b0d6-9dc3-4a55-9ab1-a9817db80734 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:47.017824 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a99b0d6-9dc3-4a55-9ab1-a9817db80734 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:47.018274 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a99b0d6-9dc3-4a55-9ab1-a9817db80734 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:47.019039 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a99b0d6-9dc3-4a55-9ab1-a9817db80734 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:47.019495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1a99b0d6-9dc3-4a55-9ab1-a9817db80734 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:47.223578 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1a99b0d6-9dc3-4a55-9ab1-a9817db80734 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:47.231174 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1a99b0d6-9dc3-4a55-9ab1-a9817db80734 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1507 microversion: 2.1 time: 0.225316 Jul 20 17:53:47.231842 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 304/602] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:47 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:47.250736 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6aab0457-c565-49ad-becd-4751cab9f72f tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5f37e23-f4b3-4ac2-92e2-56cfe235a722", "device": "/dev/sdb"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:47.252388 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6aab0457-c565-49ad-becd-4751cab9f72f tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:47.258757 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6aab0457-c565-49ad-becd-4751cab9f72f tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:47.259208 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6aab0457-c565-49ad-becd-4751cab9f72f tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:47.260030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6aab0457-c565-49ad-becd-4751cab9f72f tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:47.260480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6aab0457-c565-49ad-becd-4751cab9f72f tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:47.548709 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6d404c1d-39d2-480a-8145-cb50c84d32a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:47.549412 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6d404c1d-39d2-480a-8145-cb50c84d32a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:47.556856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6d404c1d-39d2-480a-8145-cb50c84d32a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:47.557317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6d404c1d-39d2-480a-8145-cb50c84d32a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:47.558930 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6d404c1d-39d2-480a-8145-cb50c84d32a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:47.559936 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6d404c1d-39d2-480a-8145-cb50c84d32a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:47.758313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6d404c1d-39d2-480a-8145-cb50c84d32a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:47.766241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6d404c1d-39d2-480a-8145-cb50c84d32a7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.221663 Jul 20 17:53:47.766805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 305/603] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:47 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:47.771168 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5f8844d9-b590-4a47-988a-e0ffe94199c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:47.771713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5f8844d9-b590-4a47-988a-e0ffe94199c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:47.777346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5f8844d9-b590-4a47-988a-e0ffe94199c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:47.777886 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5f8844d9-b590-4a47-988a-e0ffe94199c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:47.778644 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5f8844d9-b590-4a47-988a-e0ffe94199c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:47.779083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5f8844d9-b590-4a47-988a-e0ffe94199c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:47.964468 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5f8844d9-b590-4a47-988a-e0ffe94199c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:47.972543 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5f8844d9-b590-4a47-988a-e0ffe94199c9 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.204706 Jul 20 17:53:47.973160 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 306/604] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:47 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:48.049631 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6aab0457-c565-49ad-becd-4751cab9f72f tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "POST /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803096 Jul 20 17:53:48.050204 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 299/605] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:53:47 2022] POST /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:53:48.640567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-2607cce8-1240-4ffa-a0e6-637e46fabd9f req-2798f07f-21d4-48a3-a9e6-9729a9f6a8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb538a5-8c91-4cb8-8365-8902212955dc", "tag": "a173b304-4ef9-47d9-a7ac-724bf76dc579"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:48.650789 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-2607cce8-1240-4ffa-a0e6-637e46fabd9f req-2798f07f-21d4-48a3-a9e6-9729a9f6a8c5 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:48.657046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-2607cce8-1240-4ffa-a0e6-637e46fabd9f req-2798f07f-21d4-48a3-a9e6-9729a9f6a8c5 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:48.664154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-2607cce8-1240-4ffa-a0e6-637e46fabd9f req-2798f07f-21d4-48a3-a9e6-9729a9f6a8c5 service nova] Creating event network-changed:a173b304-4ef9-47d9-a7ac-724bf76dc579 for instance 2eb538a5-8c91-4cb8-8365-8902212955dc on hv-cinder-84984 Jul 20 17:53:48.669587 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-2607cce8-1240-4ffa-a0e6-637e46fabd9f req-2798f07f-21d4-48a3-a9e6-9729a9f6a8c5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033513 Jul 20 17:53:48.671005 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 307/606] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:48.784155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cb5a806f-4011-4aad-b41c-8816fcf5715b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:48.784889 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cb5a806f-4011-4aad-b41c-8816fcf5715b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:48.791408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb5a806f-4011-4aad-b41c-8816fcf5715b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:48.791857 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb5a806f-4011-4aad-b41c-8816fcf5715b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:48.792660 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb5a806f-4011-4aad-b41c-8816fcf5715b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:48.793097 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb5a806f-4011-4aad-b41c-8816fcf5715b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:48.990911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7bd9c6c5-2711-4d2f-8197-a973715c9acb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:48.991607 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7bd9c6c5-2711-4d2f-8197-a973715c9acb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:48.999347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7bd9c6c5-2711-4d2f-8197-a973715c9acb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:48.999797 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7bd9c6c5-2711-4d2f-8197-a973715c9acb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:49.000645 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7bd9c6c5-2711-4d2f-8197-a973715c9acb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:49.001084 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7bd9c6c5-2711-4d2f-8197-a973715c9acb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:49.079642 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cb5a806f-4011-4aad-b41c-8816fcf5715b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:49.082080 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:49.089066 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cb5a806f-4011-4aad-b41c-8816fcf5715b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.309573 Jul 20 17:53:49.093826 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 300/607] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:48 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:49.185114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7bd9c6c5-2711-4d2f-8197-a973715c9acb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:49.192999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7bd9c6c5-2711-4d2f-8197-a973715c9acb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.206469 Jul 20 17:53:49.193570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 308/608] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:48 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:50.105905 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-090749a9-5692-422a-9f7d-7564836b9cfb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:50.106524 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-090749a9-5692-422a-9f7d-7564836b9cfb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:50.113967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-090749a9-5692-422a-9f7d-7564836b9cfb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:50.114413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-090749a9-5692-422a-9f7d-7564836b9cfb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:50.115176 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-090749a9-5692-422a-9f7d-7564836b9cfb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:50.115608 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-090749a9-5692-422a-9f7d-7564836b9cfb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:50.210101 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5912c8f3-659f-4b5d-bfdf-1f76bf6b0708 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:50.210834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5912c8f3-659f-4b5d-bfdf-1f76bf6b0708 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:50.217374 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5912c8f3-659f-4b5d-bfdf-1f76bf6b0708 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:50.217931 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5912c8f3-659f-4b5d-bfdf-1f76bf6b0708 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:50.218805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5912c8f3-659f-4b5d-bfdf-1f76bf6b0708 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:50.219380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5912c8f3-659f-4b5d-bfdf-1f76bf6b0708 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:50.276459 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-090749a9-5692-422a-9f7d-7564836b9cfb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:50.284752 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-090749a9-5692-422a-9f7d-7564836b9cfb tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.182930 Jul 20 17:53:50.285325 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 301/609] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:50 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:50.359098 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5912c8f3-659f-4b5d-bfdf-1f76bf6b0708 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:50.366462 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5912c8f3-659f-4b5d-bfdf-1f76bf6b0708 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.160765 Jul 20 17:53:50.367024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 309/610] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:50 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:51.300712 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-09af3eac-1564-4416-8e91-13d9d3d2ab93 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:51.301321 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-09af3eac-1564-4416-8e91-13d9d3d2ab93 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:51.307663 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09af3eac-1564-4416-8e91-13d9d3d2ab93 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:51.308100 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09af3eac-1564-4416-8e91-13d9d3d2ab93 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:51.308886 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09af3eac-1564-4416-8e91-13d9d3d2ab93 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:51.309915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-09af3eac-1564-4416-8e91-13d9d3d2ab93 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:51.383731 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-15a635de-058f-409c-8329-839eea47304b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:51.384314 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-15a635de-058f-409c-8329-839eea47304b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:51.390800 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-15a635de-058f-409c-8329-839eea47304b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:51.391243 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-15a635de-058f-409c-8329-839eea47304b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:51.406773 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-15a635de-058f-409c-8329-839eea47304b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:51.406773 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-15a635de-058f-409c-8329-839eea47304b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:51.483483 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-09af3eac-1564-4416-8e91-13d9d3d2ab93 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:51.491663 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-09af3eac-1564-4416-8e91-13d9d3d2ab93 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.194674 Jul 20 17:53:51.492235 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 302/611] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:51 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:51.547053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-15a635de-058f-409c-8329-839eea47304b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:51.554484 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-15a635de-058f-409c-8329-839eea47304b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.174564 Jul 20 17:53:51.557441 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 310/612] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:51 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:52.509892 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-98404d35-2ec3-42ac-84ce-b07d16297fb2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:52.510503 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-98404d35-2ec3-42ac-84ce-b07d16297fb2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:52.517628 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98404d35-2ec3-42ac-84ce-b07d16297fb2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:52.518084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98404d35-2ec3-42ac-84ce-b07d16297fb2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:52.518886 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98404d35-2ec3-42ac-84ce-b07d16297fb2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:52.519323 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98404d35-2ec3-42ac-84ce-b07d16297fb2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:52.572216 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-123d26ea-0729-4e3a-ad1f-a56cb4f8be2f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:52.572856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-123d26ea-0729-4e3a-ad1f-a56cb4f8be2f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:52.579866 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-123d26ea-0729-4e3a-ad1f-a56cb4f8be2f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:52.580316 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-123d26ea-0729-4e3a-ad1f-a56cb4f8be2f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:52.581616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-123d26ea-0729-4e3a-ad1f-a56cb4f8be2f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:52.581616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-123d26ea-0729-4e3a-ad1f-a56cb4f8be2f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:52.702255 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-98404d35-2ec3-42ac-84ce-b07d16297fb2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:52.710343 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-98404d35-2ec3-42ac-84ce-b07d16297fb2 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.204294 Jul 20 17:53:52.710913 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 303/613] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:52 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:52.744393 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-123d26ea-0729-4e3a-ad1f-a56cb4f8be2f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:52.752651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-123d26ea-0729-4e3a-ad1f-a56cb4f8be2f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.184191 Jul 20 17:53:52.753210 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 311/614] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:52 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:53.726945 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6b8de2fe-3a31-414c-8d58-08031d23fa3e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:53.727559 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6b8de2fe-3a31-414c-8d58-08031d23fa3e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:53.729831 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:53.735250 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6b8de2fe-3a31-414c-8d58-08031d23fa3e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:53.739564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6b8de2fe-3a31-414c-8d58-08031d23fa3e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:53.739564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6b8de2fe-3a31-414c-8d58-08031d23fa3e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:53.739564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6b8de2fe-3a31-414c-8d58-08031d23fa3e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:53.769352 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c2906b7b-a2e0-4d83-9547-d931bc7819b3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:53.770183 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c2906b7b-a2e0-4d83-9547-d931bc7819b3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:53.772193 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:53.773382 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=10 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:53.781493 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2906b7b-a2e0-4d83-9547-d931bc7819b3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:53.781954 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2906b7b-a2e0-4d83-9547-d931bc7819b3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:53.782734 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2906b7b-a2e0-4d83-9547-d931bc7819b3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:53.783165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c2906b7b-a2e0-4d83-9547-d931bc7819b3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:54.190891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6b8de2fe-3a31-414c-8d58-08031d23fa3e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:54.198918 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6b8de2fe-3a31-414c-8d58-08031d23fa3e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.475770 Jul 20 17:53:54.199498 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 304/615] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:53 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:54.207460 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c2906b7b-a2e0-4d83-9547-d931bc7819b3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:54.214749 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c2906b7b-a2e0-4d83-9547-d931bc7819b3 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.449259 Jul 20 17:53:54.215322 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 312/616] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:53 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:55.215921 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f362db14-a32b-4e5e-b6d0-00ad217a9a3f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:55.216480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f362db14-a32b-4e5e-b6d0-00ad217a9a3f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:55.224672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f362db14-a32b-4e5e-b6d0-00ad217a9a3f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:55.225161 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f362db14-a32b-4e5e-b6d0-00ad217a9a3f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:55.226153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f362db14-a32b-4e5e-b6d0-00ad217a9a3f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:55.226514 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f362db14-a32b-4e5e-b6d0-00ad217a9a3f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:55.231743 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-af4f21c5-e9eb-4b66-a6da-8a4904ea2f0c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:55.232543 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-af4f21c5-e9eb-4b66-a6da-8a4904ea2f0c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:55.238690 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-af4f21c5-e9eb-4b66-a6da-8a4904ea2f0c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:55.239146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-af4f21c5-e9eb-4b66-a6da-8a4904ea2f0c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:55.239905 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-af4f21c5-e9eb-4b66-a6da-8a4904ea2f0c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:55.240340 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-af4f21c5-e9eb-4b66-a6da-8a4904ea2f0c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:55.435888 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-af4f21c5-e9eb-4b66-a6da-8a4904ea2f0c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:55.442993 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f362db14-a32b-4e5e-b6d0-00ad217a9a3f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:55.444161 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-af4f21c5-e9eb-4b66-a6da-8a4904ea2f0c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.216398 Jul 20 17:53:55.444968 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 313/617] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:55 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:55.452246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f362db14-a32b-4e5e-b6d0-00ad217a9a3f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.240948 Jul 20 17:53:55.452993 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 305/618] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:55 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:55.937853 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-8f064868-2808-4196-a5fb-b18671863f27 req-c11a8157-1b68-43e3-9a05-f52b3a37d85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb538a5-8c91-4cb8-8365-8902212955dc", "name": "network-vif-plugged", "status": "completed", "tag": "a173b304-4ef9-47d9-a7ac-724bf76dc579"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:53:55.946056 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-8f064868-2808-4196-a5fb-b18671863f27 req-c11a8157-1b68-43e3-9a05-f52b3a37d85f service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:55.946497 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-8f064868-2808-4196-a5fb-b18671863f27 req-c11a8157-1b68-43e3-9a05-f52b3a37d85f service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:55.956998 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-8f064868-2808-4196-a5fb-b18671863f27 req-c11a8157-1b68-43e3-9a05-f52b3a37d85f service nova] Creating event network-vif-plugged:a173b304-4ef9-47d9-a7ac-724bf76dc579 for instance 2eb538a5-8c91-4cb8-8365-8902212955dc on hv-cinder-84984 Jul 20 17:53:55.961785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-8f064868-2808-4196-a5fb-b18671863f27 req-c11a8157-1b68-43e3-9a05-f52b3a37d85f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028224 Jul 20 17:53:55.962357 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 314/619] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:53:56.461417 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-90903803-3691-4777-b674-c837ab054d26 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:56.462021 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-90903803-3691-4777-b674-c837ab054d26 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:56.469188 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-90903803-3691-4777-b674-c837ab054d26 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:56.469646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-90903803-3691-4777-b674-c837ab054d26 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:56.470381 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-90903803-3691-4777-b674-c837ab054d26 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:56.470809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-90903803-3691-4777-b674-c837ab054d26 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:56.471000 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bfc7adf2-ac61-4450-8d3f-ac565586a57e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:56.471713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-bfc7adf2-ac61-4450-8d3f-ac565586a57e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:56.478807 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bfc7adf2-ac61-4450-8d3f-ac565586a57e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:56.479256 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bfc7adf2-ac61-4450-8d3f-ac565586a57e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:56.480024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bfc7adf2-ac61-4450-8d3f-ac565586a57e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:56.480478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bfc7adf2-ac61-4450-8d3f-ac565586a57e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:56.691242 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-90903803-3691-4777-b674-c837ab054d26 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:56.699612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-90903803-3691-4777-b674-c837ab054d26 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.241924 Jul 20 17:53:56.700636 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 306/620] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:56 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:56.708015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-bfc7adf2-ac61-4450-8d3f-ac565586a57e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:56.717845 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-bfc7adf2-ac61-4450-8d3f-ac565586a57e tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.252085 Jul 20 17:53:56.718405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 315/621] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:56 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:57.716905 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b4470cb2-4061-4b11-8c6e-292571ab4bbc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:57.717508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b4470cb2-4061-4b11-8c6e-292571ab4bbc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:57.724088 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4470cb2-4061-4b11-8c6e-292571ab4bbc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:57.724567 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4470cb2-4061-4b11-8c6e-292571ab4bbc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:57.725322 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4470cb2-4061-4b11-8c6e-292571ab4bbc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:57.725752 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4470cb2-4061-4b11-8c6e-292571ab4bbc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:57.734832 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ef97982f-9d31-4ea1-86df-4b5c182e0700 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:57.735438 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ef97982f-9d31-4ea1-86df-4b5c182e0700 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:57.741723 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ef97982f-9d31-4ea1-86df-4b5c182e0700 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:57.742165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ef97982f-9d31-4ea1-86df-4b5c182e0700 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:57.742911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ef97982f-9d31-4ea1-86df-4b5c182e0700 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:57.743342 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ef97982f-9d31-4ea1-86df-4b5c182e0700 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:57.927795 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b4470cb2-4061-4b11-8c6e-292571ab4bbc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:57.936386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b4470cb2-4061-4b11-8c6e-292571ab4bbc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.223899 Jul 20 17:53:57.937202 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 307/622] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:57 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:57.942356 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ef97982f-9d31-4ea1-86df-4b5c182e0700 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:57.951326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ef97982f-9d31-4ea1-86df-4b5c182e0700 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.220204 Jul 20 17:53:57.951896 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 316/623] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:57 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:53:58.952677 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8d035ae5-7534-4eba-b5dc-9c9ce5e40d12 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:58.953287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8d035ae5-7534-4eba-b5dc-9c9ce5e40d12 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:58.959808 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8d035ae5-7534-4eba-b5dc-9c9ce5e40d12 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:58.960254 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8d035ae5-7534-4eba-b5dc-9c9ce5e40d12 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:58.961047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8d035ae5-7534-4eba-b5dc-9c9ce5e40d12 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:58.961484 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8d035ae5-7534-4eba-b5dc-9c9ce5e40d12 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:58.969380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-069cd2c6-52da-4d27-acb3-095b98cbe10d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:53:58.969968 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-069cd2c6-52da-4d27-acb3-095b98cbe10d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:53:58.976606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-069cd2c6-52da-4d27-acb3-095b98cbe10d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:58.977055 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-069cd2c6-52da-4d27-acb3-095b98cbe10d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:58.977811 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-069cd2c6-52da-4d27-acb3-095b98cbe10d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:53:58.978811 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-069cd2c6-52da-4d27-acb3-095b98cbe10d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:53:59.166371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8d035ae5-7534-4eba-b5dc-9c9ce5e40d12 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:59.173747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8d035ae5-7534-4eba-b5dc-9c9ce5e40d12 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.224934 Jul 20 17:53:59.174318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 308/624] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:58 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:53:59.181734 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-069cd2c6-52da-4d27-acb3-095b98cbe10d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:53:59.190113 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-069cd2c6-52da-4d27-acb3-095b98cbe10d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.225903 Jul 20 17:53:59.190664 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 317/625] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:53:58 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:00.192049 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a14e8bf7-32d0-4baa-a65e-cba0ce9c71f0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:00.192710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a14e8bf7-32d0-4baa-a65e-cba0ce9c71f0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:00.199014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a14e8bf7-32d0-4baa-a65e-cba0ce9c71f0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.199464 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a14e8bf7-32d0-4baa-a65e-cba0ce9c71f0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.200252 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a14e8bf7-32d0-4baa-a65e-cba0ce9c71f0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.200713 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a14e8bf7-32d0-4baa-a65e-cba0ce9c71f0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.206390 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f1afcc21-69f2-4709-ac6c-07d8bf6e83a9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:00.211487 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f1afcc21-69f2-4709-ac6c-07d8bf6e83a9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:00.213384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f1afcc21-69f2-4709-ac6c-07d8bf6e83a9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.213827 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f1afcc21-69f2-4709-ac6c-07d8bf6e83a9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.214569 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f1afcc21-69f2-4709-ac6c-07d8bf6e83a9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.214999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f1afcc21-69f2-4709-ac6c-07d8bf6e83a9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.431787 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a14e8bf7-32d0-4baa-a65e-cba0ce9c71f0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:00.439899 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a14e8bf7-32d0-4baa-a65e-cba0ce9c71f0 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1367 microversion: 2.1 time: 0.251995 Jul 20 17:54:00.440510 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 309/626] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:00 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:00.445275 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3cdf4a2b-0dfc-452e-9992-44fb46ba1983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:00.449410 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3cdf4a2b-0dfc-452e-9992-44fb46ba1983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:00.451652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cdf4a2b-0dfc-452e-9992-44fb46ba1983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.452931 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cdf4a2b-0dfc-452e-9992-44fb46ba1983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.453052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cdf4a2b-0dfc-452e-9992-44fb46ba1983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.453388 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3cdf4a2b-0dfc-452e-9992-44fb46ba1983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.460291 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f1afcc21-69f2-4709-ac6c-07d8bf6e83a9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:00.469913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f1afcc21-69f2-4709-ac6c-07d8bf6e83a9 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1755 microversion: 2.1 time: 0.267168 Jul 20 17:54:00.471233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 318/627] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:00 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1755 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:00.489172 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3cdf4a2b-0dfc-452e-9992-44fb46ba1983 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments/eb42ae2f-9c3b-4147-bbee-769020f31a5f" status: 200 len: 194 microversion: 2.20 time: 0.047590 Jul 20 17:54:00.489770 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 310/628] 10.222.0.42 () {60 vars in 1453 bytes} [Wed Jul 20 17:54:00 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments/eb42ae2f-9c3b-4147-bbee-769020f31a5f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:54:00.571626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a8be14ac-e006-4fd2-9693-8b02d7f6aa5e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:00.572112 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a8be14ac-e006-4fd2-9693-8b02d7f6aa5e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:00.578927 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a8be14ac-e006-4fd2-9693-8b02d7f6aa5e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.579369 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a8be14ac-e006-4fd2-9693-8b02d7f6aa5e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.580230 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a8be14ac-e006-4fd2-9693-8b02d7f6aa5e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.580620 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a8be14ac-e006-4fd2-9693-8b02d7f6aa5e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.667984 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-a8be14ac-e006-4fd2-9693-8b02d7f6aa5e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lazy-loading 'services' on Instance uuid 45b246c9-d9df-4348-9d5a-61c1170b1951 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:54:00.931251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a8be14ac-e006-4fd2-9693-8b02d7f6aa5e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "DELETE /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments/eb42ae2f-9c3b-4147-bbee-769020f31a5f" status: 202 len: 0 microversion: 2.20 time: 0.363333 Jul 20 17:54:00.932036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 319/629] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jul 20 17:54:00 2022] DELETE /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments/eb42ae2f-9c3b-4147-bbee-769020f31a5f => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:54:00.943556 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-63f63c32-485a-4885-9f33-c655008404f0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:00.944574 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-63f63c32-485a-4885-9f33-c655008404f0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:00.951763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63f63c32-485a-4885-9f33-c655008404f0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.956113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63f63c32-485a-4885-9f33-c655008404f0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.956113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63f63c32-485a-4885-9f33-c655008404f0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:00.956113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-63f63c32-485a-4885-9f33-c655008404f0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:00.986522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-63f63c32-485a-4885-9f33-c655008404f0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046847 Jul 20 17:54:00.987075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 311/630] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jul 20 17:54:00 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:54:01.460077 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c293a884-ca61-4c0c-a23c-2ad5e88bf711 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:01.462013 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c293a884-ca61-4c0c-a23c-2ad5e88bf711 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:01.469493 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c293a884-ca61-4c0c-a23c-2ad5e88bf711 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:01.469971 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c293a884-ca61-4c0c-a23c-2ad5e88bf711 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:01.471137 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c293a884-ca61-4c0c-a23c-2ad5e88bf711 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:01.471240 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c293a884-ca61-4c0c-a23c-2ad5e88bf711 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:01.490897 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-daef1d1a-7a7a-4896-bee3-49eb82314549 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:01.492394 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-daef1d1a-7a7a-4896-bee3-49eb82314549 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:01.500709 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-daef1d1a-7a7a-4896-bee3-49eb82314549 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:01.500709 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-daef1d1a-7a7a-4896-bee3-49eb82314549 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:01.501379 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-daef1d1a-7a7a-4896-bee3-49eb82314549 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:01.501919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-daef1d1a-7a7a-4896-bee3-49eb82314549 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:01.686839 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c293a884-ca61-4c0c-a23c-2ad5e88bf711 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:01.697150 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c293a884-ca61-4c0c-a23c-2ad5e88bf711 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1557 microversion: 2.1 time: 0.243798 Jul 20 17:54:01.697763 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 320/631] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:01 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1557 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:01.713363 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-daef1d1a-7a7a-4896-bee3-49eb82314549 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:01.716331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bf17ff7c-e998-4847-bdd9-31e5ef239953 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:01.716876 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-bf17ff7c-e998-4847-bdd9-31e5ef239953 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:01.722598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-daef1d1a-7a7a-4896-bee3-49eb82314549 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1758 microversion: 2.1 time: 0.235488 Jul 20 17:54:01.725957 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bf17ff7c-e998-4847-bdd9-31e5ef239953 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:01.726081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 312/632] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:01 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1758 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:01.726194 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bf17ff7c-e998-4847-bdd9-31e5ef239953 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:01.726194 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bf17ff7c-e998-4847-bdd9-31e5ef239953 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:01.726194 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bf17ff7c-e998-4847-bdd9-31e5ef239953 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:01.728922 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:01.802924 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-bf17ff7c-e998-4847-bdd9-31e5ef239953 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091250 Jul 20 17:54:01.803536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 321/633] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jul 20 17:54:01 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:54:01.999418 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f6ae81a2-1eec-4c73-ac83-ef2d781b461b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:02.000512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f6ae81a2-1eec-4c73-ac83-ef2d781b461b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:02.008626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6ae81a2-1eec-4c73-ac83-ef2d781b461b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:02.009238 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6ae81a2-1eec-4c73-ac83-ef2d781b461b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:02.010141 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6ae81a2-1eec-4c73-ac83-ef2d781b461b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:02.010690 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6ae81a2-1eec-4c73-ac83-ef2d781b461b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:02.046140 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f6ae81a2-1eec-4c73-ac83-ef2d781b461b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051243 Jul 20 17:54:02.047547 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 313/634] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jul 20 17:54:01 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:54:02.815794 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-aaedb05d-ad86-41b3-b0fa-181eee7ee360 req-46233cb1-4c46-4288-afa6-8dc08b54860c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb538a5-8c91-4cb8-8365-8902212955dc", "tag": "a173b304-4ef9-47d9-a7ac-724bf76dc579"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:02.824039 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-aaedb05d-ad86-41b3-b0fa-181eee7ee360 req-46233cb1-4c46-4288-afa6-8dc08b54860c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:02.824688 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-aaedb05d-ad86-41b3-b0fa-181eee7ee360 req-46233cb1-4c46-4288-afa6-8dc08b54860c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:02.839277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-aaedb05d-ad86-41b3-b0fa-181eee7ee360 req-46233cb1-4c46-4288-afa6-8dc08b54860c service nova] Creating event network-changed:a173b304-4ef9-47d9-a7ac-724bf76dc579 for instance 2eb538a5-8c91-4cb8-8365-8902212955dc on hv-cinder-84984 Jul 20 17:54:02.845181 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-aaedb05d-ad86-41b3-b0fa-181eee7ee360 req-46233cb1-4c46-4288-afa6-8dc08b54860c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036934 Jul 20 17:54:02.845874 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 322/635] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:03.058565 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fa840055-d819-4754-924a-02137cdb2287 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:03.059506 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fa840055-d819-4754-924a-02137cdb2287 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:03.067539 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fa840055-d819-4754-924a-02137cdb2287 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:03.067984 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fa840055-d819-4754-924a-02137cdb2287 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:03.068782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fa840055-d819-4754-924a-02137cdb2287 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:03.069216 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fa840055-d819-4754-924a-02137cdb2287 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:03.102343 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fa840055-d819-4754-924a-02137cdb2287 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047723 Jul 20 17:54:03.102920 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 314/636] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jul 20 17:54:03 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:54:04.119092 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2e873aa0-4d59-4856-97cb-f3ad4e4c7583 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:04.120117 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2e873aa0-4d59-4856-97cb-f3ad4e4c7583 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:04.127599 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2e873aa0-4d59-4856-97cb-f3ad4e4c7583 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:04.128041 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2e873aa0-4d59-4856-97cb-f3ad4e4c7583 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:04.128813 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2e873aa0-4d59-4856-97cb-f3ad4e4c7583 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:04.129241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2e873aa0-4d59-4856-97cb-f3ad4e4c7583 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:04.158463 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2e873aa0-4d59-4856-97cb-f3ad4e4c7583 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043665 Jul 20 17:54:04.159016 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 323/637] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jul 20 17:54:04 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:54:05.170259 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6aaf191e-2cea-4003-8763-dec33dd86200 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:05.171210 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6aaf191e-2cea-4003-8763-dec33dd86200 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:05.177758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6aaf191e-2cea-4003-8763-dec33dd86200 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:05.178211 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6aaf191e-2cea-4003-8763-dec33dd86200 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:05.178975 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6aaf191e-2cea-4003-8763-dec33dd86200 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:05.179452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6aaf191e-2cea-4003-8763-dec33dd86200 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:05.208987 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6aaf191e-2cea-4003-8763-dec33dd86200 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042691 Jul 20 17:54:05.209540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 315/638] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jul 20 17:54:05 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:54:06.221845 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1406ce01-98b1-4008-bfc5-fe8b6f1c20fd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:06.222809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1406ce01-98b1-4008-bfc5-fe8b6f1c20fd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:06.230178 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1406ce01-98b1-4008-bfc5-fe8b6f1c20fd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:06.230740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1406ce01-98b1-4008-bfc5-fe8b6f1c20fd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:06.231439 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1406ce01-98b1-4008-bfc5-fe8b6f1c20fd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:06.231874 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1406ce01-98b1-4008-bfc5-fe8b6f1c20fd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:06.260952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1406ce01-98b1-4008-bfc5-fe8b6f1c20fd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043640 Jul 20 17:54:06.261501 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 324/639] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jul 20 17:54:06 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:54:07.273182 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a2131593-74dc-467c-8277-fc42c91c23cd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:07.274159 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a2131593-74dc-467c-8277-fc42c91c23cd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:07.280678 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a2131593-74dc-467c-8277-fc42c91c23cd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:07.281129 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a2131593-74dc-467c-8277-fc42c91c23cd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:07.281892 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a2131593-74dc-467c-8277-fc42c91c23cd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:07.282332 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a2131593-74dc-467c-8277-fc42c91c23cd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:07.311318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a2131593-74dc-467c-8277-fc42c91c23cd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042136 Jul 20 17:54:07.314734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 316/640] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jul 20 17:54:07 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:07.373092 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2961fc31-af82-4c6a-a47b-cf0d8014a07a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:07.373598 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2961fc31-af82-4c6a-a47b-cf0d8014a07a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:07.379994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2961fc31-af82-4c6a-a47b-cf0d8014a07a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:07.380458 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2961fc31-af82-4c6a-a47b-cf0d8014a07a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:07.381241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2961fc31-af82-4c6a-a47b-cf0d8014a07a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:07.381680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2961fc31-af82-4c6a-a47b-cf0d8014a07a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:07.407644 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2961fc31-af82-4c6a-a47b-cf0d8014a07a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:54:07.707380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2961fc31-af82-4c6a-a47b-cf0d8014a07a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "DELETE /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 204 len: 0 microversion: 2.20 time: 0.337960 Jul 20 17:54:07.707969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 325/641] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jul 20 17:54:07 2022] DELETE /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 17:54:07.717230 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:07.717962 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:07.725073 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:07.725537 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:07.726272 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:07.726699 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:07.741076 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:07.854903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:07.862670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:07.864185 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:07.865378 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c4aaa6cc-248c-48c2-a4ed-eb017f3d6a54 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.152892 Jul 20 17:54:07.865944 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 317/642] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:07 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:08.884042 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:08.884776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:08.891193 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:08.891637 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:08.892394 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:08.892857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:09.022142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:09.030435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:09.031940 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:09.033145 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d95308f7-3de6-40a2-b6e4-44ac69962150 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.153412 Jul 20 17:54:09.033703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 326/643] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:08 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:54:09.144807 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-181f915a-b474-42a5-b9f1-9fe2f936dc0e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:09.145281 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-181f915a-b474-42a5-b9f1-9fe2f936dc0e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:09.151893 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-181f915a-b474-42a5-b9f1-9fe2f936dc0e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:09.152344 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-181f915a-b474-42a5-b9f1-9fe2f936dc0e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:09.153166 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-181f915a-b474-42a5-b9f1-9fe2f936dc0e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:09.153600 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-181f915a-b474-42a5-b9f1-9fe2f936dc0e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:09.232574 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-181f915a-b474-42a5-b9f1-9fe2f936dc0e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lazy-loading 'services' on Instance uuid 9d909f9f-c728-4099-9e85-5d49e43f2652 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:54:09.410256 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-181f915a-b474-42a5-b9f1-9fe2f936dc0e tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652/os-volume_attachments/e5f37e23-f4b3-4ac2-92e2-56cfe235a722" status: 202 len: 0 microversion: 2.1 time: 0.269144 Jul 20 17:54:09.410839 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 318/644] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:54:09 2022] DELETE /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652/os-volume_attachments/e5f37e23-f4b3-4ac2-92e2-56cfe235a722 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:54:10.051445 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:10.051953 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:10.058448 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:10.058893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:10.059633 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:10.060716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:10.196485 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:10.204484 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:10.206002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:10.207409 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-34f18a57-5755-46ee-91d8-1c568de31437 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1724 microversion: 2.20 time: 0.159994 Jul 20 17:54:10.208190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 327/645] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:10 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:11.227281 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:11.228069 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:11.234468 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:11.234919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:11.235693 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:11.236126 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:11.309743 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:11.320505 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:11.321574 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:11.322750 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0c7e587c-8d3c-4740-b418-3c8d7010a5bb tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1656 microversion: 2.20 time: 0.100626 Jul 20 17:54:11.323314 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 319/646] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:11 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:11.365972 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-dee0571a-2d7f-4384-9bb8-96f54643bf2e req-1897cc9c-49eb-4d0f-9140-cb32d343045e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b246c9-d9df-4348-9d5a-61c1170b1951", "name": "network-vif-deleted", "tag": "c0861927-5eef-4dee-a02c-a3bed737a580"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:11.374703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-dee0571a-2d7f-4384-9bb8-96f54643bf2e req-1897cc9c-49eb-4d0f-9140-cb32d343045e service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:11.375143 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-dee0571a-2d7f-4384-9bb8-96f54643bf2e req-1897cc9c-49eb-4d0f-9140-cb32d343045e service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:11.386059 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-dee0571a-2d7f-4384-9bb8-96f54643bf2e req-1897cc9c-49eb-4d0f-9140-cb32d343045e service nova] Creating event network-vif-deleted:c0861927-5eef-4dee-a02c-a3bed737a580 for instance 45b246c9-d9df-4348-9d5a-61c1170b1951 on hv-cinder-84984 Jul 20 17:54:11.391608 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-dee0571a-2d7f-4384-9bb8-96f54643bf2e req-1897cc9c-49eb-4d0f-9140-cb32d343045e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029174 Jul 20 17:54:11.392212 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 328/647] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:11.578081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-feb37e87-fa91-4ed1-b59e-af755c3726e5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:11.578829 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-feb37e87-fa91-4ed1-b59e-af755c3726e5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:11.581528 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=62 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:11.586453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-feb37e87-fa91-4ed1-b59e-af755c3726e5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:11.588942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-feb37e87-fa91-4ed1-b59e-af755c3726e5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:11.588942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-feb37e87-fa91-4ed1-b59e-af755c3726e5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:11.588942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-feb37e87-fa91-4ed1-b59e-af755c3726e5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:11.614946 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-feb37e87-fa91-4ed1-b59e-af755c3726e5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:54:11.902295 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-feb37e87-fa91-4ed1-b59e-af755c3726e5 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 204 len: 0 microversion: 2.1 time: 0.328848 Jul 20 17:54:11.902894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 320/648] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:54:11 2022] DELETE /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:54:11.911963 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-35ea545f-731c-47a0-a883-fab362b86934 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:11.912934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-35ea545f-731c-47a0-a883-fab362b86934 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:11.919863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35ea545f-731c-47a0-a883-fab362b86934 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:11.920551 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35ea545f-731c-47a0-a883-fab362b86934 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:11.921311 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35ea545f-731c-47a0-a883-fab362b86934 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:11.921741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35ea545f-731c-47a0-a883-fab362b86934 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:12.056571 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-35ea545f-731c-47a0-a883-fab362b86934 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:12.064637 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-35ea545f-731c-47a0-a883-fab362b86934 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1513 microversion: 2.1 time: 0.156714 Jul 20 17:54:12.065373 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 329/649] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:11 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:12.341298 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:12.341961 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:12.348482 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:12.348944 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:12.349754 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:12.353969 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:12.381620 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:12.382070 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:12.382515 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lazy-loading 'fault' on Instance uuid 45b246c9-d9df-4348-9d5a-61c1170b1951 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:54:12.427191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:12.436039 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:12.437534 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:12.438950 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2b38ee3b-7e55-4746-8820-67dfa3d66913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1372 microversion: 2.20 time: 0.102027 Jul 20 17:54:12.439506 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 321/650] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:12 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:13.081652 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4685a026-53ad-4a17-a892-f3e791b6e891 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:13.082261 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4685a026-53ad-4a17-a892-f3e791b6e891 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:13.088682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4685a026-53ad-4a17-a892-f3e791b6e891 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:13.089123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4685a026-53ad-4a17-a892-f3e791b6e891 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:13.089867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4685a026-53ad-4a17-a892-f3e791b6e891 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:13.090293 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4685a026-53ad-4a17-a892-f3e791b6e891 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:13.219774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4685a026-53ad-4a17-a892-f3e791b6e891 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:13.230571 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4685a026-53ad-4a17-a892-f3e791b6e891 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1513 microversion: 2.1 time: 0.152600 Jul 20 17:54:13.231093 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 330/651] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:13 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:13.456622 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:13.457227 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:13.463547 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:13.463987 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:13.464765 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:13.465196 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:13.494496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:13.494870 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:13.495307 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lazy-loading 'fault' on Instance uuid 45b246c9-d9df-4348-9d5a-61c1170b1951 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:54:13.535459 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:13.543122 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:13.544684 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:13.545815 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-204d6960-021d-4e58-8385-fd54b36ca1df tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 200 len: 1372 microversion: 2.20 time: 0.093127 Jul 20 17:54:13.546370 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 322/652] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:13 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:14.247305 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-037451da-07df-46e0-b059-0bd3b766bdcb tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:14.247928 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-037451da-07df-46e0-b059-0bd3b766bdcb tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:14.254606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-037451da-07df-46e0-b059-0bd3b766bdcb tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:14.255047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-037451da-07df-46e0-b059-0bd3b766bdcb tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:14.255837 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-037451da-07df-46e0-b059-0bd3b766bdcb tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:14.256346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-037451da-07df-46e0-b059-0bd3b766bdcb tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:14.461519 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-037451da-07df-46e0-b059-0bd3b766bdcb tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:14.469686 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-037451da-07df-46e0-b059-0bd3b766bdcb tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1513 microversion: 2.1 time: 0.226277 Jul 20 17:54:14.470491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 331/653] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:14 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:14.563095 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:14.563960 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:14.570400 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:14.570853 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:14.571607 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:14.572037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:14.587296 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] HTTP exception thrown: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Request method failure captured: Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 HTTP/1.1 Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAqloBZOT8QeovWPr-bw3m76YmkP0503m5Fpqk8p6pC3U6Bf0ey9D1vsdxbeiM1VTM8LcaKNav7MrL62AFdB_sPcU-OUZr1miKNPxqMMI3TlvuK6vG6ZQsWRtIb5GMvHC3sa6wlQddVmbLeFqxO3AN3QKazvkvDccHE_3_cv6-aBXQ Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:54:14.588919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e0c8bf2bfe34311961a4bde7f102944"}]}] Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 311c19d7062648f78ba4c2090c58f14d Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:54:14.590711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '45b246c9-d9df-4348-9d5a-61c1170b1951'} Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:54:14.592305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:54:14.593824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:14.595084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Returning 404 to user: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:54:14.595084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e4c00252-1a3c-4525-9e43-e37503d8f29c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 404 len: 111 microversion: 2.20 time: 0.031054 Jul 20 17:54:14.595084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 323/654] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:14 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:54:14.600468 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b2fd00d0-79ef-4ded-ad36-034cd4c6181d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '.version_select at 0x7f7d3d6d7310>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:14.683291 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-cbd67773-e78c-4c8e-9361-e0356f7840a3 req-dc59c490-a778-4445-8b3d-b960b04e7c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d909f9f-c728-4099-9e85-5d49e43f2652", "name": "network-vif-deleted", "tag": "72a5820f-822f-4734-b30d-285c899befc6"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:14.691939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b2fd00d0-79ef-4ded-ad36-034cd4c6181d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1565245070" status: 204 len: 0 microversion: 2.20 time: 0.096034 Jul 20 17:54:14.692550 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 332/655] 10.222.0.42 () {60 vars in 1261 bytes} [Wed Jul 20 17:54:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1565245070 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 17:54:14.692684 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-cbd67773-e78c-4c8e-9361-e0356f7840a3 req-dc59c490-a778-4445-8b3d-b960b04e7c01 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:14.693057 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-cbd67773-e78c-4c8e-9361-e0356f7840a3 req-dc59c490-a778-4445-8b3d-b960b04e7c01 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:14.705604 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-cbd67773-e78c-4c8e-9361-e0356f7840a3 req-dc59c490-a778-4445-8b3d-b960b04e7c01 service nova] Creating event network-vif-deleted:72a5820f-822f-4734-b30d-285c899befc6 for instance 9d909f9f-c728-4099-9e85-5d49e43f2652 on hv-cinder-84984 Jul 20 17:54:14.710781 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-cbd67773-e78c-4c8e-9361-e0356f7840a3 req-dc59c490-a778-4445-8b3d-b960b04e7c01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031216 Jul 20 17:54:14.711375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 324/656] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:54:15.482275 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a7f752b2-c38e-46d6-ac49-c4ca770e214f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'create', calling method: .version_select at 0x7f7d3d752820>, body: {"keypair": {"name": "tempest-keypair-163084106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBYiPBBSHuYU4y340V+R7VAVylESwRXOnzLuQ+lwIn4UMlH6rH+32f9BFYOSabnD5GSLGjALUA7TU5bY1l7WGxQ0WMx1XvqtXSV/3G/VDCmYUgznYU/9crrBGkDMdhhvg=="}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:15.487587 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:15.488290 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:15.494441 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:15.494899 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:15.495664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:15.496106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:15.496635 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-a7f752b2-c38e-46d6-ac49-c4ca770e214f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Getting quotas for project 1e0c8bf2bfe34311961a4bde7f102944. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:54:15.501149 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-a7f752b2-c38e-46d6-ac49-c4ca770e214f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Getting quotas for user 311c19d7062648f78ba4c2090c58f14d and project 1e0c8bf2bfe34311961a4bde7f102944. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:54:15.526782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:15.527231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:15.527680 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lazy-loading 'fault' on Instance uuid 9d909f9f-c728-4099-9e85-5d49e43f2652 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:54:15.569979 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc0d03b364946a5b8af3db4e9fd4780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e93d9f177d4ed5bba338ba68547bf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:15.577949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d611846c-d153-4b18-8b63-94a86dfa5195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 200 len: 1308 microversion: 2.1 time: 0.094567 Jul 20 17:54:15.578533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 325/657] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:15 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:15.606365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a7f752b2-c38e-46d6-ac49-c4ca770e214f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.129208 Jul 20 17:54:15.607550 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 333/658] 10.222.0.42 () {62 vars in 1199 bytes} [Wed Jul 20 17:54:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 17:54:16.594297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:16.594840 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] [instance: 9d909f9f-c728-4099-9e85-5d49e43f2652] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:16.601336 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:16.601781 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:16.602543 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:16.602977 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:16.615965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] HTTP exception thrown: Instance 9d909f9f-c728-4099-9e85-5d49e43f2652 could not be found. Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Request method failure captured: Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 HTTP/1.1 Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2ECgx95CTW4xbs2MSV-aUcIq6IANgMYt7GjUZtIYtDiIq8fRBfxhQ9sXMh9s9KH_T-1Fd6pW91x4JbxngCygUqFDU68ARhszqaaF27cfvaTt3Fbj_fST0wHMwBeGoTz5c8SRD4_kUaT7NsJxilY4qvTyXlK6IZQidF1WTZqTYGmxsW0 Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 10e93d9f177d4ed5bba338ba68547bf7 Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1055718646 Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:54:16.617596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_10e93d9f177d4ed5bba338ba68547bf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10e93d9f177d4ed5bba338ba68547bf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10e93d9f177d4ed5bba338ba68547bf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/10e93d9f177d4ed5bba338ba68547bf7"}]}] Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesSnapshotTestJSON-1055718646 Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 10e93d9f177d4ed5bba338ba68547bf7 Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1055718646 Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesSnapshotTestJSON-1055718646-project Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 2bc0d03b364946a5b8af3db4e9fd4780 Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesSnapshotTestJSON-1055718646-project Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 9d909f9f-c728-4099-9e85-5d49e43f2652 could not be found. Jul 20 17:54:16.619113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '9d909f9f-c728-4099-9e85-5d49e43f2652'} Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d909f9f-c728-4099-9e85-5d49e43f2652 could not be found. Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:54:16.619934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d909f9f-c728-4099-9e85-5d49e43f2652 could not be found. Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d909f9f-c728-4099-9e85-5d49e43f2652 could not be found. Jul 20 17:54:16.624806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:16.626137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] Returning 404 to user: Instance 9d909f9f-c728-4099-9e85-5d49e43f2652 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:54:16.626137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4bd6e3ea-1aa3-406e-b87a-82e8cfbb4195 tempest-VolumesSnapshotTestJSON-1055718646 tempest-VolumesSnapshotTestJSON-1055718646-project] 10.222.0.42 "GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652" status: 404 len: 111 microversion: 2.1 time: 0.028706 Jul 20 17:54:16.626137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 326/659] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:16 2022] GET /compute/v2.1/servers/9d909f9f-c728-4099-9e85-5d49e43f2652 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:54:17.883758 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-723345966", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4543ca71-03de-461e-8540-7f258ee4032c"}], "security_groups": [{"name": "tempest-securitygroup--1191078839"}], "key_name": "tempest-keypair-163084106", "user_data": "}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:17.890846 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:17.998334 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] validate_networks() for [('4543ca71-03de-461e-8540-7f258ee4032c', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:54:18.384723 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:54:18.385152 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:54:18.385626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:54:18.386035 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:54:18.386447 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:54:18.395846 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:18.396297 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:18.397133 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:18.397579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:18.414108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Getting quotas for project 1e0c8bf2bfe34311961a4bde7f102944. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:54:18.418286 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Getting quotas for user 311c19d7062648f78ba4c2090c58f14d and project 1e0c8bf2bfe34311961a4bde7f102944. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:54:18.429231 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:54:18.431457 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:54:18.568995 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8c6386d1-a480-4ae6-b276-8bfe310a47a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.690040 Jul 20 17:54:18.569794 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 334/660] 10.222.0.42 () {62 vars in 1187 bytes} [Wed Jul 20 17:54:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 17:54:18.582375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6f1b03a0-9b03-47d1-b69b-4d1c38a17834 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:18.582375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6f1b03a0-9b03-47d1-b69b-4d1c38a17834 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:18.651814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6f1b03a0-9b03-47d1-b69b-4d1c38a17834 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:18.653769 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6f1b03a0-9b03-47d1-b69b-4d1c38a17834 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:18.655398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6f1b03a0-9b03-47d1-b69b-4d1c38a17834 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:18.656513 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6f1b03a0-9b03-47d1-b69b-4d1c38a17834 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1280 microversion: 2.20 time: 0.080962 Jul 20 17:54:18.657058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 327/661] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:18 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:19.674746 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:19.675473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:19.681860 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:19.682308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:19.683122 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:19.683570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:19.744096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:19.752514 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:19.754046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:19.757693 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0efd183f-8edc-422d-9b6b-e267db6d7a08 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1284 microversion: 2.20 time: 0.084776 Jul 20 17:54:19.757693 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 335/662] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:19 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:20.773271 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:20.773883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:20.781179 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:20.781632 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:20.782941 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:20.783380 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:20.843741 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:20.852290 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:20.853822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:20.854915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c3844bdf-e570-407c-85ab-bd5efb0bfbaa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1284 microversion: 2.20 time: 0.085571 Jul 20 17:54:20.855465 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 328/663] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:20 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:21.872277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:21.872841 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:21.879803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:21.880250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:21.881038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:21.881473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:21.945642 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:21.953621 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:21.955186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:21.956305 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0076fae7-d715-4fd2-a0b7-9a19696dc086 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1276 microversion: 2.20 time: 0.088100 Jul 20 17:54:21.956906 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 336/664] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:21 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:22.974516 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:22.975137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:22.981756 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:22.983956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:22.983956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:22.983956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:23.068556 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:23.076473 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:23.078051 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:23.079156 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c1cd5aef-0201-4205-863b-891b74ec650c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1338 microversion: 2.20 time: 0.109623 Jul 20 17:54:23.079749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 329/665] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:22 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:24.097892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:24.098570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:24.105264 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:24.105712 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:24.106564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:24.107158 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:24.111502 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a1a07cd4-c182-4a0e-aa6f-d904eab80ea0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c4a9fdb-1bbb-402e-ac95-dc451e5abef2"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:24.112830 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a1a07cd4-c182-4a0e-aa6f-d904eab80ea0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:24.119371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a1a07cd4-c182-4a0e-aa6f-d904eab80ea0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:24.119763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a1a07cd4-c182-4a0e-aa6f-d904eab80ea0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:24.120558 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a1a07cd4-c182-4a0e-aa6f-d904eab80ea0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:24.120997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a1a07cd4-c182-4a0e-aa6f-d904eab80ea0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:24.565931 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:24.573941 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:24.575437 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:24.581303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0cc26dfe-80c5-42ae-8aeb-35165de77cda tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.483342 Jul 20 17:54:24.581303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 337/666] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:24 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:24.581505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-595e1f7b-10b2-4a3d-81d4-7943575f6e97 req-4410c022-c5b3-4cac-92fb-f7e4ac927ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e70e71-0f97-4e13-8c1b-88944978cb60", "tag": "c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:24.589156 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-595e1f7b-10b2-4a3d-81d4-7943575f6e97 req-4410c022-c5b3-4cac-92fb-f7e4ac927ce0 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:24.589596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-595e1f7b-10b2-4a3d-81d4-7943575f6e97 req-4410c022-c5b3-4cac-92fb-f7e4ac927ce0 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:24.602150 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-595e1f7b-10b2-4a3d-81d4-7943575f6e97 req-4410c022-c5b3-4cac-92fb-f7e4ac927ce0 service nova] Creating event network-changed:c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9 for instance 08e70e71-0f97-4e13-8c1b-88944978cb60 on hv-cinder-84984 Jul 20 17:54:24.607048 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-595e1f7b-10b2-4a3d-81d4-7943575f6e97 req-4410c022-c5b3-4cac-92fb-f7e4ac927ce0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028830 Jul 20 17:54:24.607653 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 338/667] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:24.992253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a1a07cd4-c182-4a0e-aa6f-d904eab80ea0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884773 Jul 20 17:54:24.992990 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 330/668] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:54:24 2022] POST /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments => generated 194 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:54:25.595686 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:25.596857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:25.603037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:25.603484 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:25.604243 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:25.604701 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:25.738895 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:25.747254 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:25.761421 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:25.761421 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a594a40f-6f78-470a-91bf-9229a04283c1 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.159312 Jul 20 17:54:25.761421 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 339/669] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:25 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:26.774697 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:26.775406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:26.785633 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:26.786087 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:26.787059 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:26.789908 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:26.996999 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:27.004849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:27.006341 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:27.007432 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-473f621f-e4e1-435e-b14d-673f2cf548c4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.239150 Jul 20 17:54:27.007984 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 331/670] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:26 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:28.025949 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:28.026475 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:28.044165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:28.044693 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:28.045628 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:28.046096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:28.183244 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:28.193015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:28.205943 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:28.205943 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-03edbc48-fa6b-4a32-be2f-0b3b43f22ab4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.174055 Jul 20 17:54:28.205943 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 340/671] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:28 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:29.213666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:29.214279 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:29.216687 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:29.221763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:29.222224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:29.223029 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:29.223513 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:29.240688 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:29.428178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:29.436201 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:29.437747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:29.438863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-aca8cfa5-57b3-4fd2-94d4-824aef1f36a8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.229250 Jul 20 17:54:29.439680 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 332/672] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:29 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:30.457632 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:30.458228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:30.460111 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:30.460885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=10 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:30.466305 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:30.466884 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:30.467539 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:30.467965 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:30.471837 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:30.600428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:30.609086 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:30.610575 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:30.612168 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-36d262f6-1cf1-4cfb-a55e-80951f2c292e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.159886 Jul 20 17:54:30.612761 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 341/673] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:30 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:31.630604 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:31.631226 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:31.638029 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:31.638482 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:31.639255 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:31.639695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:31.773043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:31.780848 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:31.782368 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:31.783463 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-11497cf7-3b7f-4b35-af5a-d19242a7042b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.157412 Jul 20 17:54:31.784026 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 333/674] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:31 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:32.801725 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:32.802329 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:32.808996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:32.809449 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:32.810211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:32.810756 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:32.941830 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:32.949856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:32.960114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:32.960114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fd48ab0b-3b6f-4d3d-b9d8-b36b83c2ae93 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.155265 Jul 20 17:54:32.960114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 342/675] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:32 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:33.088759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-77f8a142-0e84-4caf-bbb5-84b9f2f8192d req-2d5fe3e0-d30e-4c43-87dd-239a171eddbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e70e71-0f97-4e13-8c1b-88944978cb60", "name": "network-vif-plugged", "status": "completed", "tag": "c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:33.097672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-77f8a142-0e84-4caf-bbb5-84b9f2f8192d req-2d5fe3e0-d30e-4c43-87dd-239a171eddbc service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:33.098126 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-77f8a142-0e84-4caf-bbb5-84b9f2f8192d req-2d5fe3e0-d30e-4c43-87dd-239a171eddbc service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:33.109461 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-77f8a142-0e84-4caf-bbb5-84b9f2f8192d req-2d5fe3e0-d30e-4c43-87dd-239a171eddbc service nova] Creating event network-vif-plugged:c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9 for instance 08e70e71-0f97-4e13-8c1b-88944978cb60 on hv-cinder-84984 Jul 20 17:54:33.114783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-77f8a142-0e84-4caf-bbb5-84b9f2f8192d req-2d5fe3e0-d30e-4c43-87dd-239a171eddbc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029848 Jul 20 17:54:33.115370 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 334/676] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:33.970553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:33.971188 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:33.977687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:33.978138 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:33.978894 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:33.979333 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:34.111826 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:34.119913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:34.121473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:34.122573 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-89c78cab-c3ad-4111-be54-9b788e711d2a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.155935 Jul 20 17:54:34.123125 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 343/677] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:33 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:34.617567 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-56425f08-7a93-4e19-af44-2b9366b1fa4c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:34.618581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-56425f08-7a93-4e19-af44-2b9366b1fa4c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:34.624823 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-56425f08-7a93-4e19-af44-2b9366b1fa4c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:34.625272 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-56425f08-7a93-4e19-af44-2b9366b1fa4c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:34.626029 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-56425f08-7a93-4e19-af44-2b9366b1fa4c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:34.626971 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-56425f08-7a93-4e19-af44-2b9366b1fa4c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:34.649443 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-56425f08-7a93-4e19-af44-2b9366b1fa4c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'flavor' on Instance uuid 134b17e0-3dcb-4586-9810-065cd7ec4243 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:54:34.922767 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-56425f08-7a93-4e19-af44-2b9366b1fa4c tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/action" status: 200 len: 32 microversion: 2.1 time: 0.309904 Jul 20 17:54:34.923372 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 335/678] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:54:34 2022] POST /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/action => generated 32 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 17:54:34.932450 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3e49da89-3f2f-4dfd-a704-5da70a688a9f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:34.933085 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3e49da89-3f2f-4dfd-a704-5da70a688a9f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:34.941119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e49da89-3f2f-4dfd-a704-5da70a688a9f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:34.941568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e49da89-3f2f-4dfd-a704-5da70a688a9f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:34.942338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e49da89-3f2f-4dfd-a704-5da70a688a9f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:34.942773 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e49da89-3f2f-4dfd-a704-5da70a688a9f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:35.088343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3e49da89-3f2f-4dfd-a704-5da70a688a9f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:35.101417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3e49da89-3f2f-4dfd-a704-5da70a688a9f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.172378 Jul 20 17:54:35.101993 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 344/679] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:34 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:35.141183 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:35.141881 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:35.148185 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:35.148691 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:35.149440 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:35.149874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:35.281886 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:35.291715 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:35.293275 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:35.294497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c4f6b8ff-73fb-4b87-821c-5a725e661e16 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1406 microversion: 2.20 time: 0.157699 Jul 20 17:54:35.295061 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 336/680] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:35 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:54:36.119268 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c94d7ce5-c8f8-47d7-b3ed-6a610ef412a3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:36.120036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c94d7ce5-c8f8-47d7-b3ed-6a610ef412a3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:36.128344 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c94d7ce5-c8f8-47d7-b3ed-6a610ef412a3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:36.131148 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c94d7ce5-c8f8-47d7-b3ed-6a610ef412a3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:36.131148 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c94d7ce5-c8f8-47d7-b3ed-6a610ef412a3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:36.131148 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c94d7ce5-c8f8-47d7-b3ed-6a610ef412a3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:36.281941 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c94d7ce5-c8f8-47d7-b3ed-6a610ef412a3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:36.293006 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c94d7ce5-c8f8-47d7-b3ed-6a610ef412a3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.177588 Jul 20 17:54:36.293579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 345/681] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:36 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:36.315403 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:36.316145 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:36.326180 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:36.326180 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:36.326180 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:36.326180 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:36.464086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:36.475326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:36.478058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:36.479219 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0ba669da-071f-4bb9-931a-dcd188224788 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1597 microversion: 2.20 time: 0.168118 Jul 20 17:54:36.479790 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 337/682] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:54:36 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1597 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:54:36.497120 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-02f350bf-861f-4293-819f-a322d6082c63 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:36.497613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-02f350bf-861f-4293-819f-a322d6082c63 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:36.504271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02f350bf-861f-4293-819f-a322d6082c63 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:36.504687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02f350bf-861f-4293-819f-a322d6082c63 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:36.505440 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02f350bf-861f-4293-819f-a322d6082c63 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:36.505870 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02f350bf-861f-4293-819f-a322d6082c63 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:36.580707 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-02f350bf-861f-4293-819f-a322d6082c63 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087357 Jul 20 17:54:36.581321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 346/683] 10.222.0.42 () {60 vars in 1315 bytes} [Wed Jul 20 17:54:36 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:54:37.310301 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cf8f332e-24f0-4804-bdd0-c154e8b8ddf1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:37.310825 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cf8f332e-24f0-4804-bdd0-c154e8b8ddf1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:37.317290 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cf8f332e-24f0-4804-bdd0-c154e8b8ddf1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:37.317883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cf8f332e-24f0-4804-bdd0-c154e8b8ddf1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:37.318552 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cf8f332e-24f0-4804-bdd0-c154e8b8ddf1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:37.318995 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cf8f332e-24f0-4804-bdd0-c154e8b8ddf1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:37.537116 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cf8f332e-24f0-4804-bdd0-c154e8b8ddf1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:37.545095 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cf8f332e-24f0-4804-bdd0-c154e8b8ddf1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.238690 Jul 20 17:54:37.545670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 338/684] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:37 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:37.639269 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-fef46695-6573-434e-b94c-79d1569d9417 req-78f1c373-97e1-4612-adbc-fd2def6985ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e70e71-0f97-4e13-8c1b-88944978cb60", "tag": "c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:37.647965 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-fef46695-6573-434e-b94c-79d1569d9417 req-78f1c373-97e1-4612-adbc-fd2def6985ff service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:37.648504 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-fef46695-6573-434e-b94c-79d1569d9417 req-78f1c373-97e1-4612-adbc-fd2def6985ff service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:37.659536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-fef46695-6573-434e-b94c-79d1569d9417 req-78f1c373-97e1-4612-adbc-fd2def6985ff service nova] Creating event network-changed:c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9 for instance 08e70e71-0f97-4e13-8c1b-88944978cb60 on hv-cinder-84984 Jul 20 17:54:37.665122 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-fef46695-6573-434e-b94c-79d1569d9417 req-78f1c373-97e1-4612-adbc-fd2def6985ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030015 Jul 20 17:54:37.665682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 347/685] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:38.562707 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fba313f3-1895-45dc-9054-e1af1e8ce12a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:38.563483 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fba313f3-1895-45dc-9054-e1af1e8ce12a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:38.570365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba313f3-1895-45dc-9054-e1af1e8ce12a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:38.570810 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba313f3-1895-45dc-9054-e1af1e8ce12a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:38.571593 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba313f3-1895-45dc-9054-e1af1e8ce12a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:38.572123 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba313f3-1895-45dc-9054-e1af1e8ce12a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:38.702205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-fba313f3-1895-45dc-9054-e1af1e8ce12a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:38.710375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fba313f3-1895-45dc-9054-e1af1e8ce12a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.151625 Jul 20 17:54:38.710946 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 339/686] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:38 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:39.728620 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-71ee118c-f4f6-4730-af12-8c50ef214f87 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:39.729341 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-71ee118c-f4f6-4730-af12-8c50ef214f87 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:39.735769 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71ee118c-f4f6-4730-af12-8c50ef214f87 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:39.736217 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71ee118c-f4f6-4730-af12-8c50ef214f87 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:39.737008 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71ee118c-f4f6-4730-af12-8c50ef214f87 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:39.737445 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-71ee118c-f4f6-4730-af12-8c50ef214f87 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:40.101162 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-71ee118c-f4f6-4730-af12-8c50ef214f87 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:40.109316 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-71ee118c-f4f6-4730-af12-8c50ef214f87 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.385427 Jul 20 17:54:40.109885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 348/687] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:39 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:41.126453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cb277b15-2d00-4641-a976-60758a18f203 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:41.127058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cb277b15-2d00-4641-a976-60758a18f203 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:41.134234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb277b15-2d00-4641-a976-60758a18f203 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:41.134688 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb277b15-2d00-4641-a976-60758a18f203 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:41.135451 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb277b15-2d00-4641-a976-60758a18f203 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:41.135891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cb277b15-2d00-4641-a976-60758a18f203 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:41.263500 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cb277b15-2d00-4641-a976-60758a18f203 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:41.271350 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cb277b15-2d00-4641-a976-60758a18f203 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.148744 Jul 20 17:54:41.271909 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 340/688] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:41 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:42.288496 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8100a218-b0ff-415c-ab43-5dc542b33e99 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:42.289035 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8100a218-b0ff-415c-ab43-5dc542b33e99 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:42.295532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8100a218-b0ff-415c-ab43-5dc542b33e99 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:42.295981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8100a218-b0ff-415c-ab43-5dc542b33e99 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:42.296770 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8100a218-b0ff-415c-ab43-5dc542b33e99 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:42.297206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8100a218-b0ff-415c-ab43-5dc542b33e99 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:42.365763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 17:54:42.366326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Wed Jul 20 17:54:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 17:54:42.433256 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8100a218-b0ff-415c-ab43-5dc542b33e99 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:42.441908 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8100a218-b0ff-415c-ab43-5dc542b33e99 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.157404 Jul 20 17:54:42.442636 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 349/689] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:42 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:43.458960 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6bc74f3a-dd84-4bb8-9675-8f4237bb9140 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:43.459553 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6bc74f3a-dd84-4bb8-9675-8f4237bb9140 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:43.461989 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:43.466839 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bc74f3a-dd84-4bb8-9675-8f4237bb9140 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:43.467280 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bc74f3a-dd84-4bb8-9675-8f4237bb9140 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:43.468040 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bc74f3a-dd84-4bb8-9675-8f4237bb9140 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:43.468540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bc74f3a-dd84-4bb8-9675-8f4237bb9140 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:43.631299 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6bc74f3a-dd84-4bb8-9675-8f4237bb9140 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:43.639523 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6bc74f3a-dd84-4bb8-9675-8f4237bb9140 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.184513 Jul 20 17:54:43.640086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 341/690] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:43 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:44.300997 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e8f97d77-3a39-4cc5-a0da-2b7eca7d2695 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-615931283"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:44.301564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e8f97d77-3a39-4cc5-a0da-2b7eca7d2695 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:44.308217 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e8f97d77-3a39-4cc5-a0da-2b7eca7d2695 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:44.308697 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e8f97d77-3a39-4cc5-a0da-2b7eca7d2695 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:44.309464 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e8f97d77-3a39-4cc5-a0da-2b7eca7d2695 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:44.309895 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e8f97d77-3a39-4cc5-a0da-2b7eca7d2695 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:44.443580 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.network.security_group_api [None req-e8f97d77-3a39-4cc5-a0da-2b7eca7d2695 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Removing security group 8b001fd3-c0ff-44ac-b09f-080a5f42198e from port 05bc7328-58f7-4b9a-89df-2347f267ebb3 Jul 20 17:54:44.657183 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-74eb66ec-574f-45b6-8a50-9b9ca5a46b20 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:44.658074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-74eb66ec-574f-45b6-8a50-9b9ca5a46b20 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:44.665944 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-74eb66ec-574f-45b6-8a50-9b9ca5a46b20 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:44.666393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-74eb66ec-574f-45b6-8a50-9b9ca5a46b20 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:44.667193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-74eb66ec-574f-45b6-8a50-9b9ca5a46b20 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:44.667714 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-74eb66ec-574f-45b6-8a50-9b9ca5a46b20 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:44.867705 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-74eb66ec-574f-45b6-8a50-9b9ca5a46b20 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:44.875866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-74eb66ec-574f-45b6-8a50-9b9ca5a46b20 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.222780 Jul 20 17:54:44.876370 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 342/691] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:44 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:44.952993 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e8f97d77-3a39-4cc5-a0da-2b7eca7d2695 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "POST /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/action" status: 202 len: 0 microversion: 2.1 time: 0.656239 Jul 20 17:54:44.953605 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 350/692] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:54:44 2022] POST /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:54:44.967621 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-3dc304c0-3655-4a3e-b843-2d6987d974be req-8e33cbf9-3ab1-4662-aeae-dbbf63669b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3192a390-865f-408d-adb6-01f03593249c", "tag": "05bc7328-58f7-4b9a-89df-2347f267ebb3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:44.985277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-3dc304c0-3655-4a3e-b843-2d6987d974be req-8e33cbf9-3ab1-4662-aeae-dbbf63669b17 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:44.988881 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-3dc304c0-3655-4a3e-b843-2d6987d974be req-8e33cbf9-3ab1-4662-aeae-dbbf63669b17 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:45.009778 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-3dc304c0-3655-4a3e-b843-2d6987d974be req-8e33cbf9-3ab1-4662-aeae-dbbf63669b17 service nova] Creating event network-changed:05bc7328-58f7-4b9a-89df-2347f267ebb3 for instance 3192a390-865f-408d-adb6-01f03593249c on hv-cinder-84984 Jul 20 17:54:45.025571 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-3dc304c0-3655-4a3e-b843-2d6987d974be req-8e33cbf9-3ab1-4662-aeae-dbbf63669b17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061498 Jul 20 17:54:45.029218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 343/693] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:45.893406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d85e6f0a-dfbd-4839-8625-41073accdf06 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:45.894039 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d85e6f0a-dfbd-4839-8625-41073accdf06 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:45.900170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d85e6f0a-dfbd-4839-8625-41073accdf06 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:45.900660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d85e6f0a-dfbd-4839-8625-41073accdf06 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:45.901422 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d85e6f0a-dfbd-4839-8625-41073accdf06 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:45.901857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d85e6f0a-dfbd-4839-8625-41073accdf06 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:46.104747 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d85e6f0a-dfbd-4839-8625-41073accdf06 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:46.114035 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d85e6f0a-dfbd-4839-8625-41073accdf06 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.224930 Jul 20 17:54:46.114752 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 351/694] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:45 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:46.451686 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7263aba4-7ed0-48cd-8e8b-1f0554a2169c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:46.452267 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7263aba4-7ed0-48cd-8e8b-1f0554a2169c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:46.459052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7263aba4-7ed0-48cd-8e8b-1f0554a2169c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:46.459501 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7263aba4-7ed0-48cd-8e8b-1f0554a2169c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:46.460376 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7263aba4-7ed0-48cd-8e8b-1f0554a2169c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:46.460853 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7263aba4-7ed0-48cd-8e8b-1f0554a2169c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:46.546247 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-7263aba4-7ed0-48cd-8e8b-1f0554a2169c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lazy-loading 'services' on Instance uuid 3192a390-865f-408d-adb6-01f03593249c {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:54:46.741328 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7263aba4-7ed0-48cd-8e8b-1f0554a2169c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments/4fcb3e4a-3cfd-4302-97b9-2b760088fbc4" status: 202 len: 0 microversion: 2.1 time: 0.293964 Jul 20 17:54:46.742672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 344/695] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:54:46 2022] DELETE /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments/4fcb3e4a-3cfd-4302-97b9-2b760088fbc4 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:54:46.751397 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7d514ace-f10c-46f1-a158-381459c48a8d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:46.752407 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7d514ace-f10c-46f1-a158-381459c48a8d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:46.759597 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d514ace-f10c-46f1-a158-381459c48a8d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:46.760448 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d514ace-f10c-46f1-a158-381459c48a8d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:46.760830 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d514ace-f10c-46f1-a158-381459c48a8d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:46.761493 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d514ace-f10c-46f1-a158-381459c48a8d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:46.791488 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7d514ace-f10c-46f1-a158-381459c48a8d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Jul 20 17:54:46.795469 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 352/696] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:54:46 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:47.043735 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-8b97cd33-25df-493e-ace4-d1bd350ed766 req-83c0a3a7-e401-4243-bc22-966270610dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3192a390-865f-408d-adb6-01f03593249c", "tag": "05bc7328-58f7-4b9a-89df-2347f267ebb3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:47.052726 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8b97cd33-25df-493e-ace4-d1bd350ed766 req-83c0a3a7-e401-4243-bc22-966270610dda service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:47.053167 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8b97cd33-25df-493e-ace4-d1bd350ed766 req-83c0a3a7-e401-4243-bc22-966270610dda service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:47.066731 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-8b97cd33-25df-493e-ace4-d1bd350ed766 req-83c0a3a7-e401-4243-bc22-966270610dda service nova] Creating event network-changed:05bc7328-58f7-4b9a-89df-2347f267ebb3 for instance 3192a390-865f-408d-adb6-01f03593249c on hv-cinder-84984 Jul 20 17:54:47.071577 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-8b97cd33-25df-493e-ace4-d1bd350ed766 req-83c0a3a7-e401-4243-bc22-966270610dda service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031961 Jul 20 17:54:47.072162 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 345/697] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:47.132016 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8eb6e31c-6aae-4bd3-b6d9-ec41180e85f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:47.132587 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8eb6e31c-6aae-4bd3-b6d9-ec41180e85f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:47.139547 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8eb6e31c-6aae-4bd3-b6d9-ec41180e85f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:47.140079 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8eb6e31c-6aae-4bd3-b6d9-ec41180e85f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:47.140874 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8eb6e31c-6aae-4bd3-b6d9-ec41180e85f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:47.141308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8eb6e31c-6aae-4bd3-b6d9-ec41180e85f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:47.278226 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8eb6e31c-6aae-4bd3-b6d9-ec41180e85f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:47.286722 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8eb6e31c-6aae-4bd3-b6d9-ec41180e85f2 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.159231 Jul 20 17:54:47.287292 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 353/698] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:47 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:47.804505 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1ee03ac1-a57e-4fcf-9b5a-c7513b23418f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:47.806129 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1ee03ac1-a57e-4fcf-9b5a-c7513b23418f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:47.813011 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1ee03ac1-a57e-4fcf-9b5a-c7513b23418f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:47.813462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1ee03ac1-a57e-4fcf-9b5a-c7513b23418f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:47.814226 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1ee03ac1-a57e-4fcf-9b5a-c7513b23418f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:47.814929 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1ee03ac1-a57e-4fcf-9b5a-c7513b23418f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:47.843508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1ee03ac1-a57e-4fcf-9b5a-c7513b23418f tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Jul 20 17:54:47.844075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 346/699] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:54:47 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:48.303798 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8b193ddb-0713-4ac4-a000-ec269cefe3fc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:48.304451 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8b193ddb-0713-4ac4-a000-ec269cefe3fc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:48.306826 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:48.311608 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8b193ddb-0713-4ac4-a000-ec269cefe3fc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:48.312051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8b193ddb-0713-4ac4-a000-ec269cefe3fc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:48.312830 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8b193ddb-0713-4ac4-a000-ec269cefe3fc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:48.313269 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8b193ddb-0713-4ac4-a000-ec269cefe3fc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:48.444948 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8b193ddb-0713-4ac4-a000-ec269cefe3fc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:48.452841 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8b193ddb-0713-4ac4-a000-ec269cefe3fc tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.153492 Jul 20 17:54:48.453405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 354/700] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:48 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:48.854393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b4df5a7f-24cb-40f0-8942-521e905770b4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:48.855223 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b4df5a7f-24cb-40f0-8942-521e905770b4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:48.861664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4df5a7f-24cb-40f0-8942-521e905770b4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:48.862118 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4df5a7f-24cb-40f0-8942-521e905770b4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:48.863546 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4df5a7f-24cb-40f0-8942-521e905770b4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:48.863984 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b4df5a7f-24cb-40f0-8942-521e905770b4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:48.891067 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b4df5a7f-24cb-40f0-8942-521e905770b4 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040725 Jul 20 17:54:48.891622 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 347/701] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:54:48 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 17:54:48.901476 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:48.901969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:48.907847 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:48.908297 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:48.909091 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:48.910066 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:48.981503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] HTTP exception thrown: Instance 3192a390-865f-408d-adb6-01f03593249c is not attached to volume 4fcb3e4a-3cfd-4302-97b9-2b760088fbc4 Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Request method failure captured: Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments/4fcb3e4a-3cfd-4302-97b9-2b760088fbc4 HTTP/1.1 Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2ECixXTJXWQiz9VqbBJoVaeij8WMRA7H5ihQMoUe8MLfWQjeLYp4g_ALzXLqKUISH2E9P61W76FOwDIacuN6DH8laOe0lirg2EP4n0GLIR-1qBZnoeyiKoHUAaxrdDSQ4k86uYOpA9iSyQ02RBSdh1T7Zg_gjfIHKafKP1MZR2bWIYE Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 63d0c5b02155444fb44a732c46674b8f Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-TestMinimumBasicScenario-1571592085 Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:54:48.983881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_63d0c5b02155444fb44a732c46674b8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/63d0c5b02155444fb44a732c46674b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/63d0c5b02155444fb44a732c46674b8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/63d0c5b02155444fb44a732c46674b8f"}]}] Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-TestMinimumBasicScenario-1571592085 Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 63d0c5b02155444fb44a732c46674b8f Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1571592085 Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-TestMinimumBasicScenario-1571592085-project Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: e72199904d9642e6bf9cacb7af568ddb Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-TestMinimumBasicScenario-1571592085-project Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:54:48.985592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 3192a390-865f-408d-adb6-01f03593249c is not attached to volume 4fcb3e4a-3cfd-4302-97b9-2b760088fbc4 Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'server_id': '3192a390-865f-408d-adb6-01f03593249c', 'id': '4fcb3e4a-3cfd-4302-97b9-2b760088fbc4'} Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4fcb3e4a-3cfd-4302-97b9-2b760088fbc4. Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:54:48.986465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3192a390-865f-408d-adb6-01f03593249c is not attached to volume 4fcb3e4a-3cfd-4302-97b9-2b760088fbc4 Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3192a390-865f-408d-adb6-01f03593249c is not attached to volume 4fcb3e4a-3cfd-4302-97b9-2b760088fbc4 Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:48.988330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Returning 404 to user: Instance 3192a390-865f-408d-adb6-01f03593249c is not attached to volume 4fcb3e4a-3cfd-4302-97b9-2b760088fbc4 {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:54:48.990091 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-88cbd49c-ea1d-4b21-af36-ec2bf7372924 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments/4fcb3e4a-3cfd-4302-97b9-2b760088fbc4" status: 404 len: 154 microversion: 2.1 time: 0.087921 Jul 20 17:54:48.990091 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 355/702] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:54:48 2022] DELETE /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c/os-volume_attachments/4fcb3e4a-3cfd-4302-97b9-2b760088fbc4 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:54:49.470406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-84cddb7e-a513-4429-ba12-05de6b5009e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:49.471049 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-84cddb7e-a513-4429-ba12-05de6b5009e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:49.478095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-84cddb7e-a513-4429-ba12-05de6b5009e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:49.478551 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-84cddb7e-a513-4429-ba12-05de6b5009e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:49.479331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-84cddb7e-a513-4429-ba12-05de6b5009e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:49.479779 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-84cddb7e-a513-4429-ba12-05de6b5009e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:49.606628 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b5769113-0529-4779-b055-c0f67651d207 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:49.607117 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b5769113-0529-4779-b055-c0f67651d207 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:49.612153 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-84cddb7e-a513-4429-ba12-05de6b5009e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:49.613190 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5769113-0529-4779-b055-c0f67651d207 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:49.613636 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5769113-0529-4779-b055-c0f67651d207 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:49.614398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5769113-0529-4779-b055-c0f67651d207 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:49.614828 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5769113-0529-4779-b055-c0f67651d207 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:49.620419 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-84cddb7e-a513-4429-ba12-05de6b5009e7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.153984 Jul 20 17:54:49.621045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 356/703] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:49 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:49.628898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:49.638293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b5769113-0529-4779-b055-c0f67651d207 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/ips" status: 200 len: 149 microversion: 2.1 time: 0.207967 Jul 20 17:54:49.638834 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 348/704] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 17:54:49 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/ips => generated 149 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:50.264368 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-39497f0a-97f2-4f82-8925-9d48e1db26d7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:50.264885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-39497f0a-97f2-4f82-8925-9d48e1db26d7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:50.270891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-39497f0a-97f2-4f82-8925-9d48e1db26d7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:50.271330 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-39497f0a-97f2-4f82-8925-9d48e1db26d7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:50.272078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-39497f0a-97f2-4f82-8925-9d48e1db26d7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:50.272529 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-39497f0a-97f2-4f82-8925-9d48e1db26d7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:50.297554 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-39497f0a-97f2-4f82-8925-9d48e1db26d7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:54:50.398999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:54:50.580929 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-39497f0a-97f2-4f82-8925-9d48e1db26d7 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 204 len: 0 microversion: 2.1 time: 0.320005 Jul 20 17:54:50.582359 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 357/705] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:54:50 2022] DELETE /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:54:50.590610 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f0cbbaed-545a-4942-be47-58d5205ff98b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:50.591213 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f0cbbaed-545a-4942-be47-58d5205ff98b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:50.598404 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f0cbbaed-545a-4942-be47-58d5205ff98b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:50.598846 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f0cbbaed-545a-4942-be47-58d5205ff98b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:50.599599 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f0cbbaed-545a-4942-be47-58d5205ff98b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:50.600029 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f0cbbaed-545a-4942-be47-58d5205ff98b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:50.638810 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9ed270b2-421d-443c-9470-f6925a4af1cd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:50.639517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9ed270b2-421d-443c-9470-f6925a4af1cd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:50.646248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ed270b2-421d-443c-9470-f6925a4af1cd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:50.646700 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ed270b2-421d-443c-9470-f6925a4af1cd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:50.647473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ed270b2-421d-443c-9470-f6925a4af1cd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:50.647911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ed270b2-421d-443c-9470-f6925a4af1cd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:50.772907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f0cbbaed-545a-4942-be47-58d5205ff98b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:50.781509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f0cbbaed-545a-4942-be47-58d5205ff98b tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1554 microversion: 2.1 time: 0.194588 Jul 20 17:54:50.782089 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 349/706] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:50 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:50.816852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9ed270b2-421d-443c-9470-f6925a4af1cd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:50.824682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9ed270b2-421d-443c-9470-f6925a4af1cd tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.190264 Jul 20 17:54:50.825240 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 358/707] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:50 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:51.244722 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-051dfcd1-f41d-492c-a0a0-60e722c130ff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52d89961-4303-40ce-bb2a-a9ab3ab567e9"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:51.245778 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-051dfcd1-f41d-492c-a0a0-60e722c130ff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:51.251744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-051dfcd1-f41d-492c-a0a0-60e722c130ff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:51.252193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-051dfcd1-f41d-492c-a0a0-60e722c130ff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:51.252998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-051dfcd1-f41d-492c-a0a0-60e722c130ff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:51.253947 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-051dfcd1-f41d-492c-a0a0-60e722c130ff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:51.799386 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1f39cf2e-ba6a-42f0-a950-7ee93e628a2c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:51.800513 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1f39cf2e-ba6a-42f0-a950-7ee93e628a2c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:51.806818 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f39cf2e-ba6a-42f0-a950-7ee93e628a2c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:51.807308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f39cf2e-ba6a-42f0-a950-7ee93e628a2c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:51.808054 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f39cf2e-ba6a-42f0-a950-7ee93e628a2c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:51.808509 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f39cf2e-ba6a-42f0-a950-7ee93e628a2c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:51.937657 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1f39cf2e-ba6a-42f0-a950-7ee93e628a2c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:51.945255 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1f39cf2e-ba6a-42f0-a950-7ee93e628a2c tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1554 microversion: 2.1 time: 0.149797 Jul 20 17:54:51.945813 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 359/708] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:51 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:51.951022 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2c48c0ad-18a8-4878-840e-021e9c1ab7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:51.951755 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2c48c0ad-18a8-4878-840e-021e9c1ab7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:51.957360 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2c48c0ad-18a8-4878-840e-021e9c1ab7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:51.957804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2c48c0ad-18a8-4878-840e-021e9c1ab7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:51.958552 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2c48c0ad-18a8-4878-840e-021e9c1ab7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:51.958986 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2c48c0ad-18a8-4878-840e-021e9c1ab7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:52.086748 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2c48c0ad-18a8-4878-840e-021e9c1ab7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:52.094503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2c48c0ad-18a8-4878-840e-021e9c1ab7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.146975 Jul 20 17:54:52.095060 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 360/709] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:51 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:52.963779 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f4e990bc-12c5-49ef-9ea6-a782d2311939 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:52.970627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f4e990bc-12c5-49ef-9ea6-a782d2311939 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:52.970871 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f4e990bc-12c5-49ef-9ea6-a782d2311939 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:52.971323 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f4e990bc-12c5-49ef-9ea6-a782d2311939 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:52.972113 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f4e990bc-12c5-49ef-9ea6-a782d2311939 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:52.972573 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f4e990bc-12c5-49ef-9ea6-a782d2311939 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:53.363828 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-051dfcd1-f41d-492c-a0a0-60e722c130ff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.122412 Jul 20 17:54:53.369220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 350/710] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:54:51 2022] POST /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments => generated 194 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:53.374657 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0cf2ea85-fe5c-4800-b1f4-be7c3233f17e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:53.375364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0cf2ea85-fe5c-4800-b1f4-be7c3233f17e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:53.383484 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cf2ea85-fe5c-4800-b1f4-be7c3233f17e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:53.383939 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cf2ea85-fe5c-4800-b1f4-be7c3233f17e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:53.384739 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cf2ea85-fe5c-4800-b1f4-be7c3233f17e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:53.385184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0cf2ea85-fe5c-4800-b1f4-be7c3233f17e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:53.397459 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f4e990bc-12c5-49ef-9ea6-a782d2311939 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:53.405433 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f4e990bc-12c5-49ef-9ea6-a782d2311939 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1554 microversion: 2.1 time: 0.446248 Jul 20 17:54:53.416189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 361/711] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:52 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1554 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:53.567359 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0cf2ea85-fe5c-4800-b1f4-be7c3233f17e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:53.575187 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0cf2ea85-fe5c-4800-b1f4-be7c3233f17e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.204767 Jul 20 17:54:53.575755 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 351/712] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:53 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:53.772360 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-ec760a8e-4afd-4d4a-85ec-df215f4d3ef1 req-e25d13ad-676f-49fa-af1a-4ab74f166031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3192a390-865f-408d-adb6-01f03593249c", "name": "network-vif-deleted", "tag": "05bc7328-58f7-4b9a-89df-2347f267ebb3"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:53.780358 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-ec760a8e-4afd-4d4a-85ec-df215f4d3ef1 req-e25d13ad-676f-49fa-af1a-4ab74f166031 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:53.780852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-ec760a8e-4afd-4d4a-85ec-df215f4d3ef1 req-e25d13ad-676f-49fa-af1a-4ab74f166031 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:53.792046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-ec760a8e-4afd-4d4a-85ec-df215f4d3ef1 req-e25d13ad-676f-49fa-af1a-4ab74f166031 service nova] Creating event network-vif-deleted:05bc7328-58f7-4b9a-89df-2347f267ebb3 for instance 3192a390-865f-408d-adb6-01f03593249c on hv-cinder-84984 Jul 20 17:54:53.797099 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-ec760a8e-4afd-4d4a-85ec-df215f4d3ef1 req-e25d13ad-676f-49fa-af1a-4ab74f166031 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086075 Jul 20 17:54:53.797678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 362/713] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:54:54.423065 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:54.423677 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:54.430077 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:54.430521 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:54.431280 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:54.431744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:54.463251 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:54.463703 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:54.464151 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lazy-loading 'fault' on Instance uuid 3192a390-865f-408d-adb6-01f03593249c {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:54:54.505845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:54.513777 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e9e34993-0470-4a1b-8572-879881298eba tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1348 microversion: 2.1 time: 0.094552 Jul 20 17:54:54.514741 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 352/714] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:54 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:54.593329 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c1bf9a0e-49f9-4715-88c1-558808b9e1e6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:54.594028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c1bf9a0e-49f9-4715-88c1-558808b9e1e6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:54.600982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c1bf9a0e-49f9-4715-88c1-558808b9e1e6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:54.601436 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c1bf9a0e-49f9-4715-88c1-558808b9e1e6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:54.602373 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c1bf9a0e-49f9-4715-88c1-558808b9e1e6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:54.602972 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c1bf9a0e-49f9-4715-88c1-558808b9e1e6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:54.736529 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c1bf9a0e-49f9-4715-88c1-558808b9e1e6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:54.745705 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c1bf9a0e-49f9-4715-88c1-558808b9e1e6 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1735 microversion: 2.1 time: 0.156494 Jul 20 17:54:54.750062 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 363/715] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:54 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:55.529901 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:55.530507 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:55.537737 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:55.538177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:55.538935 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:55.539365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:55.571811 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:55.572253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:55.572955 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lazy-loading 'fault' on Instance uuid 3192a390-865f-408d-adb6-01f03593249c {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:54:55.627683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72199904d9642e6bf9cacb7af568ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d0c5b02155444fb44a732c46674b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:55.635948 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-602c988d-457a-4a53-ba21-945363c7bd7a tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 200 len: 1348 microversion: 2.1 time: 0.109834 Jul 20 17:54:55.636529 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 353/716] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:55 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 1348 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:55.763286 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-95a83f74-a98f-4c39-8b2c-47b0d36d72d7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:55.763893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-95a83f74-a98f-4c39-8b2c-47b0d36d72d7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:55.769879 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-95a83f74-a98f-4c39-8b2c-47b0d36d72d7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:55.770926 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-95a83f74-a98f-4c39-8b2c-47b0d36d72d7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:55.771675 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-95a83f74-a98f-4c39-8b2c-47b0d36d72d7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:55.772102 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-95a83f74-a98f-4c39-8b2c-47b0d36d72d7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:55.899947 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-95a83f74-a98f-4c39-8b2c-47b0d36d72d7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:55.908115 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-95a83f74-a98f-4c39-8b2c-47b0d36d72d7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1715 microversion: 2.1 time: 0.148840 Jul 20 17:54:55.909960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 364/717] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:55 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:56.009904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:56.010405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:56.018268 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:56.019233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:56.020070 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:56.020576 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:56.104963 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] HTTP exception thrown: Cannot 'detach_volume' instance 134b17e0-3dcb-4586-9810-065cd7ec4243 while it is in vm_state rescued Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Request method failure captured: Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: DELETE /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments/9c4a9fdb-1bbb-402e-ac95-dc451e5abef2 HTTP/1.1 Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2ECFR8Chf_-oC5r4ltXJ63KUnxvQuEmcxamgLZkPzUQBaz6u_DRxVxJh81w11ssb1D_5EnfdMiUucEa-pyrvFRYV06pWwIIiHHbWBmycepP5B806CKpRGnYDA__HD_ppgbQ3YrlOygxDiDxAFTS3iVoixCYUCzSkehzwaC58aAjvgvc Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:54:56.106676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bde6b55e64864d188ee5fafc4b9edc4a"}]}] Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 8daac4acc2fb4d47a7549ef710a70fca Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:54:56.108266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Cannot 'detach_volume' instance 134b17e0-3dcb-4586-9810-065cd7ec4243 while it is in vm_state rescued Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'server_id': '134b17e0-3dcb-4586-9810-065cd7ec4243', 'id': '9c4a9fdb-1bbb-402e-ac95-dc451e5abef2'} Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 134b17e0-3dcb-4586-9810-065cd7ec4243 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:54:56.109177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 134b17e0-3dcb-4586-9810-065cd7ec4243 while it is in vm_state rescued Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 134b17e0-3dcb-4586-9810-065cd7ec4243 while it is in vm_state rescued Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.110662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Returning 409 to user: Cannot 'detach_volume' instance 134b17e0-3dcb-4586-9810-065cd7ec4243 while it is in vm_state rescued {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:54:56.111793 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-02fef323-38fc-49d6-bd8b-7e3ff048ef15 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "DELETE /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments/9c4a9fdb-1bbb-402e-ac95-dc451e5abef2" status: 409 len: 152 microversion: 2.1 time: 0.104994 Jul 20 17:54:56.111793 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 354/718] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:54:56 2022] DELETE /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments/9c4a9fdb-1bbb-402e-ac95-dc451e5abef2 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 17:54:56.119985 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5055e9db-5525-4bee-976e-a42374a787ab tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:54:56.122034 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5055e9db-5525-4bee-976e-a42374a787ab tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:56.126576 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5055e9db-5525-4bee-976e-a42374a787ab tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:56.127022 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5055e9db-5525-4bee-976e-a42374a787ab tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:56.127774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5055e9db-5525-4bee-976e-a42374a787ab tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:56.128302 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5055e9db-5525-4bee-976e-a42374a787ab tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:56.367900 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5055e9db-5525-4bee-976e-a42374a787ab tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "POST /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/action" status: 202 len: 0 microversion: 2.1 time: 0.251595 Jul 20 17:54:56.368471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 365/719] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:54:56 2022] POST /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:54:56.376380 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-87829626-f239-43c3-957a-5297003ae95d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:56.380031 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-87829626-f239-43c3-957a-5297003ae95d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:56.383619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87829626-f239-43c3-957a-5297003ae95d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:56.384169 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87829626-f239-43c3-957a-5297003ae95d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:56.384958 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87829626-f239-43c3-957a-5297003ae95d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:56.385396 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87829626-f239-43c3-957a-5297003ae95d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:56.546451 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-87829626-f239-43c3-957a-5297003ae95d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:56.555140 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-87829626-f239-43c3-957a-5297003ae95d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1723 microversion: 2.1 time: 0.182476 Jul 20 17:54:56.555789 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 355/720] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:56 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:54:56.654064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:56.654734 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] [instance: 3192a390-865f-408d-adb6-01f03593249c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:56.660916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:56.661364 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:56.662120 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:56.662550 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:56.677171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] HTTP exception thrown: Instance 3192a390-865f-408d-adb6-01f03593249c could not be found. Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Request method failure captured: Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c HTTP/1.1 Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2ECixXTJXWQiz9VqbBJoVaeij8WMRA7H5ihQMoUe8MLfWQjeLYp4g_ALzXLqKUISH2E9P61W76FOwDIacuN6DH8laOe0lirg2EP4n0GLIR-1qBZnoeyiKoHUAaxrdDSQ4k86uYOpA9iSyQ02RBSdh1T7Zg_gjfIHKafKP1MZR2bWIYE Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 63d0c5b02155444fb44a732c46674b8f Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-TestMinimumBasicScenario-1571592085 Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:54:56.682567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_63d0c5b02155444fb44a732c46674b8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/63d0c5b02155444fb44a732c46674b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/63d0c5b02155444fb44a732c46674b8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/63d0c5b02155444fb44a732c46674b8f"}]}] Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-TestMinimumBasicScenario-1571592085 Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 63d0c5b02155444fb44a732c46674b8f Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1571592085 Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-TestMinimumBasicScenario-1571592085-project Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: e72199904d9642e6bf9cacb7af568ddb Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-TestMinimumBasicScenario-1571592085-project Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 3192a390-865f-408d-adb6-01f03593249c could not be found. Jul 20 17:54:56.684076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '3192a390-865f-408d-adb6-01f03593249c'} Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3192a390-865f-408d-adb6-01f03593249c could not be found. Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:54:56.685002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3192a390-865f-408d-adb6-01f03593249c could not be found. Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3192a390-865f-408d-adb6-01f03593249c could not be found. Jul 20 17:54:56.686432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:54:56.687721 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Returning 404 to user: Instance 3192a390-865f-408d-adb6-01f03593249c could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:54:56.687721 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b39ce4a2-60aa-440a-b3cb-527817afc4b5 tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c" status: 404 len: 111 microversion: 2.1 time: 0.030672 Jul 20 17:54:56.687721 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 366/721] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:56 2022] GET /compute/v2.1/servers/3192a390-865f-408d-adb6-01f03593249c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:54:56.692943 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-feb098dd-5e42-4df0-bf79-74e1337e3f6d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] Calling method '.version_select at 0x7f7d3dfa5ee0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:56.794574 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-feb098dd-5e42-4df0-bf79-74e1337e3f6d tempest-TestMinimumBasicScenario-1571592085 tempest-TestMinimumBasicScenario-1571592085-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1063112530" status: 202 len: 0 microversion: 2.1 time: 0.107556 Jul 20 17:54:56.795156 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 356/722] 10.222.0.42 () {58 vars in 1271 bytes} [Wed Jul 20 17:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1063112530 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:54:57.573383 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-44db7c37-ee63-4308-8d57-0fc5671ceb18 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:57.573975 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-44db7c37-ee63-4308-8d57-0fc5671ceb18 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:57.580372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-44db7c37-ee63-4308-8d57-0fc5671ceb18 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:57.580856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-44db7c37-ee63-4308-8d57-0fc5671ceb18 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:57.582006 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-44db7c37-ee63-4308-8d57-0fc5671ceb18 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:57.582006 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-44db7c37-ee63-4308-8d57-0fc5671ceb18 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:57.718194 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-44db7c37-ee63-4308-8d57-0fc5671ceb18 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:57.727066 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-44db7c37-ee63-4308-8d57-0fc5671ceb18 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1723 microversion: 2.1 time: 0.157562 Jul 20 17:54:57.727621 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 367/723] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:57 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:54:58.744934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c5561c84-466a-4579-9666-b462f9110704 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:54:58.745543 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c5561c84-466a-4579-9666-b462f9110704 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:54:58.751505 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c5561c84-466a-4579-9666-b462f9110704 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:58.751948 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c5561c84-466a-4579-9666-b462f9110704 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:58.752729 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c5561c84-466a-4579-9666-b462f9110704 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:54:58.753163 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c5561c84-466a-4579-9666-b462f9110704 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:54:59.012228 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c5561c84-466a-4579-9666-b462f9110704 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:54:59.021250 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c5561c84-466a-4579-9666-b462f9110704 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1723 microversion: 2.1 time: 0.280139 Jul 20 17:54:59.021832 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 357/724] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:54:58 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:00.038596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a6c67e52-cfd0-42b1-a0af-03dc5bfc9d2e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:00.039199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a6c67e52-cfd0-42b1-a0af-03dc5bfc9d2e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:00.045663 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a6c67e52-cfd0-42b1-a0af-03dc5bfc9d2e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:00.046110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a6c67e52-cfd0-42b1-a0af-03dc5bfc9d2e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:00.046857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a6c67e52-cfd0-42b1-a0af-03dc5bfc9d2e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:00.047290 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a6c67e52-cfd0-42b1-a0af-03dc5bfc9d2e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:00.185452 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a6c67e52-cfd0-42b1-a0af-03dc5bfc9d2e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:00.194369 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a6c67e52-cfd0-42b1-a0af-03dc5bfc9d2e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1729 microversion: 2.1 time: 0.160129 Jul 20 17:55:00.195154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 368/725] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:00 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:00.211141 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-42dd7c6c-f3b1-4ef1-8bba-ad4385c1ff42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:00.211688 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-42dd7c6c-f3b1-4ef1-8bba-ad4385c1ff42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:00.218205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-42dd7c6c-f3b1-4ef1-8bba-ad4385c1ff42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:00.218657 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-42dd7c6c-f3b1-4ef1-8bba-ad4385c1ff42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:00.219515 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-42dd7c6c-f3b1-4ef1-8bba-ad4385c1ff42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:00.220218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-42dd7c6c-f3b1-4ef1-8bba-ad4385c1ff42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:00.303072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-42dd7c6c-f3b1-4ef1-8bba-ad4385c1ff42 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095813 Jul 20 17:55:00.303954 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 358/726] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jul 20 17:55:00 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:01.931385 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-d7265b21-01b4-4d72-a337-6019e71f2cd6 req-a5843bc5-42ee-42b5-a0e1-3f49aadebf98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134b17e0-3dcb-4586-9810-065cd7ec4243", "tag": "3ed31386-5e58-4b1f-be48-e5bcbda66a7d"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:01.934976 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-d7265b21-01b4-4d72-a337-6019e71f2cd6 req-a5843bc5-42ee-42b5-a0e1-3f49aadebf98 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:01.935849 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-d7265b21-01b4-4d72-a337-6019e71f2cd6 req-a5843bc5-42ee-42b5-a0e1-3f49aadebf98 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:01.951784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-d7265b21-01b4-4d72-a337-6019e71f2cd6 req-a5843bc5-42ee-42b5-a0e1-3f49aadebf98 service nova] Creating event network-changed:3ed31386-5e58-4b1f-be48-e5bcbda66a7d for instance 134b17e0-3dcb-4586-9810-065cd7ec4243 on hv-cinder-84984 Jul 20 17:55:01.959779 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-d7265b21-01b4-4d72-a337-6019e71f2cd6 req-a5843bc5-42ee-42b5-a0e1-3f49aadebf98 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146207 Jul 20 17:55:01.960385 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 369/727] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:03.082545 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52d89961-4303-40ce-bb2a-a9ab3ab567e9"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:03.084580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:03.094863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:03.095524 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:03.097132 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:03.097947 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:03.209001 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Invalid volume: volume 52d89961-4303-40ce-bb2a-a9ab3ab567e9 is already attached to instances: 2eb538a5-8c91-4cb8-8365-8902212955dc Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: POST /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments HTTP/1.1 Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 74 Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:55:03.212316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {"volumeAttachment": {"volumeId": "52d89961-4303-40ce-bb2a-a9ab3ab567e9"}} Jul 20 17:55:03.214008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Invalid volume: volume 52d89961-4303-40ce-bb2a-a9ab3ab567e9 is already attached to instances: 2eb538a5-8c91-4cb8-8365-8902212955dc Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'server_id': '2eb538a5-8c91-4cb8-8365-8902212955dc', 'body': {'volumeAttachment': {'volumeId': '52d89961-4303-40ce-bb2a-a9ab3ab567e9'}}} Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 52d89961-4303-40ce-bb2a-a9ab3ab567e9 is already attached to instances: 2eb538a5-8c91-4cb8-8365-8902212955dc Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:03.215037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 52d89961-4303-40ce-bb2a-a9ab3ab567e9 is already attached to instances: 2eb538a5-8c91-4cb8-8365-8902212955dc Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:55:03.216284 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:55:03.217626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:55:03.217626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:55:03.217626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:55:03.217626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 52d89961-4303-40ce-bb2a-a9ab3ab567e9 is already attached to instances: 2eb538a5-8c91-4cb8-8365-8902212955dc Jul 20 17:55:03.217626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:03.217626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 400 to user: Invalid volume: volume 52d89961-4303-40ce-bb2a-a9ab3ab567e9 is already attached to instances: 2eb538a5-8c91-4cb8-8365-8902212955dc {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:55:03.217626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0f3917f0-0e66-419d-b439-fa5a5f24060b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136164 Jul 20 17:55:03.218207 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 359/728] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:55:03 2022] POST /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:55:03.280263 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4db7802f-5795-480f-86c3-ecbdffe28f87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:03.281294 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4db7802f-5795-480f-86c3-ecbdffe28f87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:03.289098 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4db7802f-5795-480f-86c3-ecbdffe28f87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:03.289559 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4db7802f-5795-480f-86c3-ecbdffe28f87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:03.290339 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4db7802f-5795-480f-86c3-ecbdffe28f87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:03.290779 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4db7802f-5795-480f-86c3-ecbdffe28f87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:03.387044 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-4db7802f-5795-480f-86c3-ecbdffe28f87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lazy-loading 'services' on Instance uuid 2eb538a5-8c91-4cb8-8365-8902212955dc {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:55:03.981357 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4db7802f-5795-480f-86c3-ecbdffe28f87 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments/52d89961-4303-40ce-bb2a-a9ab3ab567e9" status: 202 len: 0 microversion: 2.1 time: 0.705480 Jul 20 17:55:03.984948 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 370/729] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:55:03 2022] DELETE /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments/52d89961-4303-40ce-bb2a-a9ab3ab567e9 => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:55:03.990650 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a6727fdd-b051-421f-bd8a-7e623c86b008 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:03.991683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a6727fdd-b051-421f-bd8a-7e623c86b008 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:03.998167 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6727fdd-b051-421f-bd8a-7e623c86b008 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:03.998696 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6727fdd-b051-421f-bd8a-7e623c86b008 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:03.999694 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6727fdd-b051-421f-bd8a-7e623c86b008 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:04.000342 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6727fdd-b051-421f-bd8a-7e623c86b008 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:04.008109 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-4ca428fc-150b-483e-85a1-1c74dc70e709 req-600a5747-605b-43d5-82ea-b2f36e817c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134b17e0-3dcb-4586-9810-065cd7ec4243", "tag": "3ed31386-5e58-4b1f-be48-e5bcbda66a7d"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:04.017206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-4ca428fc-150b-483e-85a1-1c74dc70e709 req-600a5747-605b-43d5-82ea-b2f36e817c25 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:04.019366 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-4ca428fc-150b-483e-85a1-1c74dc70e709 req-600a5747-605b-43d5-82ea-b2f36e817c25 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:04.029492 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-4ca428fc-150b-483e-85a1-1c74dc70e709 req-600a5747-605b-43d5-82ea-b2f36e817c25 service nova] Creating event network-changed:3ed31386-5e58-4b1f-be48-e5bcbda66a7d for instance 134b17e0-3dcb-4586-9810-065cd7ec4243 on hv-cinder-84984 Jul 20 17:55:04.033542 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a6727fdd-b051-421f-bd8a-7e623c86b008 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046881 Jul 20 17:55:04.034225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 360/730] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:55:03 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:55:04.035557 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-4ca428fc-150b-483e-85a1-1c74dc70e709 req-600a5747-605b-43d5-82ea-b2f36e817c25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032967 Jul 20 17:55:04.036652 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 371/731] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:05.047123 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5ea96bd5-c28f-4750-91d2-294f5eb5a440 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:05.050575 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5ea96bd5-c28f-4750-91d2-294f5eb5a440 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:05.055873 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ea96bd5-c28f-4750-91d2-294f5eb5a440 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:05.056690 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ea96bd5-c28f-4750-91d2-294f5eb5a440 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:05.058001 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ea96bd5-c28f-4750-91d2-294f5eb5a440 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:05.059048 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5ea96bd5-c28f-4750-91d2-294f5eb5a440 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:05.094282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5ea96bd5-c28f-4750-91d2-294f5eb5a440 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052530 Jul 20 17:55:05.100374 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 361/732] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:55:05 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:06.108747 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ebd39317-b54b-42f0-a43e-33a6655e1610 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:06.116935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ebd39317-b54b-42f0-a43e-33a6655e1610 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:06.124640 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ebd39317-b54b-42f0-a43e-33a6655e1610 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:06.125320 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ebd39317-b54b-42f0-a43e-33a6655e1610 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:06.126116 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ebd39317-b54b-42f0-a43e-33a6655e1610 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:06.131211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ebd39317-b54b-42f0-a43e-33a6655e1610 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:06.172315 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ebd39317-b54b-42f0-a43e-33a6655e1610 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067874 Jul 20 17:55:06.173285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 372/733] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:55:06 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 17:55:06.259988 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9609d8b3-a391-4816-bd79-74cec1982a7a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:06.260590 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9609d8b3-a391-4816-bd79-74cec1982a7a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:06.269664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9609d8b3-a391-4816-bd79-74cec1982a7a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:06.270430 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9609d8b3-a391-4816-bd79-74cec1982a7a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:06.273617 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9609d8b3-a391-4816-bd79-74cec1982a7a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:06.275236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9609d8b3-a391-4816-bd79-74cec1982a7a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:06.310115 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9609d8b3-a391-4816-bd79-74cec1982a7a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:55:06.660297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9609d8b3-a391-4816-bd79-74cec1982a7a tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 204 len: 0 microversion: 2.1 time: 0.399837 Jul 20 17:55:06.663772 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 362/734] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:55:06 2022] DELETE /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:55:06.670066 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1aaab3eb-b273-4e76-935d-58aa94159244 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:06.670719 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1aaab3eb-b273-4e76-935d-58aa94159244 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:06.677851 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1aaab3eb-b273-4e76-935d-58aa94159244 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:06.678847 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1aaab3eb-b273-4e76-935d-58aa94159244 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:06.679826 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1aaab3eb-b273-4e76-935d-58aa94159244 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:06.680463 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1aaab3eb-b273-4e76-935d-58aa94159244 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:06.850259 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1aaab3eb-b273-4e76-935d-58aa94159244 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:06.857906 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1aaab3eb-b273-4e76-935d-58aa94159244 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1681 microversion: 2.1 time: 0.191646 Jul 20 17:55:06.858870 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 373/735] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:06 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:07.875734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c889f234-d9c0-4fca-94e4-fefe0a8d6f31 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:07.876558 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c889f234-d9c0-4fca-94e4-fefe0a8d6f31 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:07.883641 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c889f234-d9c0-4fca-94e4-fefe0a8d6f31 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:07.884187 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c889f234-d9c0-4fca-94e4-fefe0a8d6f31 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:07.885053 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c889f234-d9c0-4fca-94e4-fefe0a8d6f31 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:07.885554 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c889f234-d9c0-4fca-94e4-fefe0a8d6f31 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:07.889544 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:08.017150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c889f234-d9c0-4fca-94e4-fefe0a8d6f31 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:08.024477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c889f234-d9c0-4fca-94e4-fefe0a8d6f31 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1681 microversion: 2.1 time: 0.153073 Jul 20 17:55:08.025043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 363/736] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:07 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:09.043021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-52f4da2d-57a6-434e-9953-8bc4762c7205 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:09.044236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-52f4da2d-57a6-434e-9953-8bc4762c7205 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:09.054906 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52f4da2d-57a6-434e-9953-8bc4762c7205 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:09.055141 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52f4da2d-57a6-434e-9953-8bc4762c7205 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:09.055966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52f4da2d-57a6-434e-9953-8bc4762c7205 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:09.056411 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-52f4da2d-57a6-434e-9953-8bc4762c7205 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:09.156177 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-52f4da2d-57a6-434e-9953-8bc4762c7205 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:09.164934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-52f4da2d-57a6-434e-9953-8bc4762c7205 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1613 microversion: 2.1 time: 0.126393 Jul 20 17:55:09.165516 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 374/737] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:09 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1613 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:09.348306 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-b1b16698-6116-4435-8571-fed774a396ba req-c653c6ff-11a8-45b4-b531-6f2e864ebb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb538a5-8c91-4cb8-8365-8902212955dc", "name": "network-vif-deleted", "tag": "a173b304-4ef9-47d9-a7ac-724bf76dc579"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:09.359005 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-b1b16698-6116-4435-8571-fed774a396ba req-c653c6ff-11a8-45b4-b531-6f2e864ebb13 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:09.359453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-b1b16698-6116-4435-8571-fed774a396ba req-c653c6ff-11a8-45b4-b531-6f2e864ebb13 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:09.372225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-b1b16698-6116-4435-8571-fed774a396ba req-c653c6ff-11a8-45b4-b531-6f2e864ebb13 service nova] Creating event network-vif-deleted:a173b304-4ef9-47d9-a7ac-724bf76dc579 for instance 2eb538a5-8c91-4cb8-8365-8902212955dc on hv-cinder-84984 Jul 20 17:55:09.377276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-b1b16698-6116-4435-8571-fed774a396ba req-c653c6ff-11a8-45b4-b531-6f2e864ebb13 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033270 Jul 20 17:55:09.378262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 364/738] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:10.183712 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:10.184407 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:10.193022 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:10.193633 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:10.198336 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:10.198779 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:10.216457 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:10.236340 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:10.236818 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:10.237278 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lazy-loading 'fault' on Instance uuid 2eb538a5-8c91-4cb8-8365-8902212955dc {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:55:10.284016 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:10.292655 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-338bd48d-56d3-4349-b9ae-2810bd6ba627 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 200 len: 1331 microversion: 2.1 time: 0.114151 Jul 20 17:55:10.293416 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 375/739] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:10 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:11.311399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:11.312100 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:11.318713 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:11.319172 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:11.320869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:11.320869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:11.334027 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc HTTP/1.1 Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:55:11.335685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:55:11.337277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '2eb538a5-8c91-4cb8-8365-8902212955dc'} Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:55:11.338191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:55:11.339646 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:55:11.341904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:55:11.341904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9ab867d8-70ac-447b-861c-27aae42b84f6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 404 len: 111 microversion: 2.1 time: 0.031928 Jul 20 17:55:11.341904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 365/740] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:11 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:55:11.349053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f0d7140b-b1bf-42d3-b401-13408b40ffe7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '.version_select at 0x7f7d3d86b1f0>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:11.429813 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f0d7140b-b1bf-42d3-b401-13408b40ffe7 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796327026" status: 202 len: 0 microversion: 2.1 time: 0.084844 Jul 20 17:55:11.435757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 376/741] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jul 20 17:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796327026 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:55:12.360560 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6a67c9cf-264e-4580-901c-75b47f24f140 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: .version_select at 0x7f7d3d5e9550>, body: {"keypair": {"name": "tempest-keypair-2049868976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8shD4HAgP7PiaHUWDcToo12M6Wco22kDMZywd1Dm5ALfOeGN4BgSMaNw6EDNa/3J3PsFR+I4dmn8ObskicapRUciMIwhflD6KKl3SVYBphz22PPat0PCeAIB1ip6E3Qw=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:12.382235 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-6a67c9cf-264e-4580-901c-75b47f24f140 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for project 93918dc6b6f445d18a3ecb003524152d. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:55:12.386430 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-6a67c9cf-264e-4580-901c-75b47f24f140 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for user 3077a7934f9c4407a70a8790b8da9cde and project 93918dc6b6f445d18a3ecb003524152d. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:55:12.477863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6a67c9cf-264e-4580-901c-75b47f24f140 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119980 Jul 20 17:55:12.478392 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 366/742] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 17:55:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:13.699660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f4ca89da-57cb-41e9-965c-e6647d65ee1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:13.700797 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f4ca89da-57cb-41e9-965c-e6647d65ee1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:13.711020 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f4ca89da-57cb-41e9-965c-e6647d65ee1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:13.712148 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f4ca89da-57cb-41e9-965c-e6647d65ee1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:13.713196 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f4ca89da-57cb-41e9-965c-e6647d65ee1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:13.713849 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f4ca89da-57cb-41e9-965c-e6647d65ee1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:13.737940 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f4ca89da-57cb-41e9-965c-e6647d65ee1f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/ips" status: 200 len: 150 microversion: 2.20 time: 0.042044 Jul 20 17:55:13.738698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 377/743] 10.222.0.42 () {60 vars in 1288 bytes} [Wed Jul 20 17:55:13 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:55:15.139265 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-436721908", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e772fe92-4472-4af3-b6e9-3d6e16e3740d"}], "security_groups": [{"name": "tempest-securitygroup--858605023"}], "key_name": "tempest-keypair-2049868976", "user_data": "}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:15.155674 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:15.303292 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] validate_networks() for [('e772fe92-4472-4af3-b6e9-3d6e16e3740d', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:55:15.832469 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:55:15.832934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:55:15.833414 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:55:15.833854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:55:15.834294 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:55:15.843698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:15.843841 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:15.844696 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:15.845184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:15.863096 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for project 93918dc6b6f445d18a3ecb003524152d. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:55:15.867346 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Getting quotas for user 3077a7934f9c4407a70a8790b8da9cde and project 93918dc6b6f445d18a3ecb003524152d. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:55:15.878524 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:55:15.881390 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:55:16.031434 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7ec9b50d-379a-4d54-8c38-b94df2132c7b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.897275 Jul 20 17:55:16.032161 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 367/744] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:55:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:55:16.042446 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4a21d403-db5f-4883-bee3-4066e650ae54 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:16.044130 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4a21d403-db5f-4883-bee3-4066e650ae54 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:16.119672 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4a21d403-db5f-4883-bee3-4066e650ae54 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:16.132833 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4a21d403-db5f-4883-bee3-4066e650ae54 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1241 microversion: 2.1 time: 0.094514 Jul 20 17:55:16.134504 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 378/745] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:16 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:16.544845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5b4e0da7-8ca5-435c-8fdf-3ddc03c4ecd7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:16.545359 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5b4e0da7-8ca5-435c-8fdf-3ddc03c4ecd7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:16.552117 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b4e0da7-8ca5-435c-8fdf-3ddc03c4ecd7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:16.553171 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b4e0da7-8ca5-435c-8fdf-3ddc03c4ecd7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:16.553937 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b4e0da7-8ca5-435c-8fdf-3ddc03c4ecd7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:16.554371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5b4e0da7-8ca5-435c-8fdf-3ddc03c4ecd7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:16.576956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-5b4e0da7-8ca5-435c-8fdf-3ddc03c4ecd7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lazy-loading 'flavor' on Instance uuid 08e70e71-0f97-4e13-8c1b-88944978cb60 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:55:17.156735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9a962962-9fab-49b6-8d17-ef85dff8e30b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:17.157325 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9a962962-9fab-49b6-8d17-ef85dff8e30b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:17.248583 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9a962962-9fab-49b6-8d17-ef85dff8e30b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:17.279560 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5b4e0da7-8ca5-435c-8fdf-3ddc03c4ecd7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/action" status: 202 len: 0 microversion: 2.20 time: 0.721901 Jul 20 17:55:17.279975 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9a962962-9fab-49b6-8d17-ef85dff8e30b tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1241 microversion: 2.1 time: 0.111121 Jul 20 17:55:17.279975 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 379/746] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:17 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:17.280147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 368/747] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jul 20 17:55:16 2022] POST /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:55:17.280243 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:17.280243 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:17.280243 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:17.280243 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:17.280609 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:17.280696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:17.452636 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:17.461607 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:17.463150 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:17.464524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-283e755a-1d7a-454a-b6a5-9df2e9b07afa tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.197376 Jul 20 17:55:17.465143 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 380/748] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:17 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:55:18.282443 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f6a6f358-6adc-4d55-a5a2-a2c758f89614 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:18.283127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f6a6f358-6adc-4d55-a5a2-a2c758f89614 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:18.289410 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6a6f358-6adc-4d55-a5a2-a2c758f89614 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:18.289858 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6a6f358-6adc-4d55-a5a2-a2c758f89614 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:18.290617 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6a6f358-6adc-4d55-a5a2-a2c758f89614 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:18.291236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f6a6f358-6adc-4d55-a5a2-a2c758f89614 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:18.403814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f6a6f358-6adc-4d55-a5a2-a2c758f89614 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:18.416750 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f6a6f358-6adc-4d55-a5a2-a2c758f89614 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1293 microversion: 2.1 time: 0.139189 Jul 20 17:55:18.429137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 369/749] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:18 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1293 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:18.485478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:18.486090 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:18.490525 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:18.495152 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:18.495807 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:18.496790 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:18.497227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:18.853516 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:18.866470 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:18.869142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:18.870619 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a2a78855-3611-4674-8807-bfaf1def4d40 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.389136 Jul 20 17:55:18.882347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 381/750] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:18 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:19.441142 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6bb6b402-74fa-456f-81e0-d8798e4989d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:19.442404 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6bb6b402-74fa-456f-81e0-d8798e4989d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:19.460960 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bb6b402-74fa-456f-81e0-d8798e4989d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:19.461721 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bb6b402-74fa-456f-81e0-d8798e4989d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:19.463464 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bb6b402-74fa-456f-81e0-d8798e4989d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:19.464043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6bb6b402-74fa-456f-81e0-d8798e4989d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:19.619331 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6bb6b402-74fa-456f-81e0-d8798e4989d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:19.629124 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6bb6b402-74fa-456f-81e0-d8798e4989d5 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1299 microversion: 2.1 time: 0.196597 Jul 20 17:55:19.630127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 370/751] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:19 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1299 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:19.889495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:19.890787 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:19.898315 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:19.899073 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:19.900063 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:19.900887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:20.600605 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:20.610904 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:20.612789 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:20.614425 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1e5d21ff-8d4f-440b-a36a-77da797e525d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.729208 Jul 20 17:55:20.616094 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 382/752] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:19 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:20.653121 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f7299358-8280-4417-abb0-0e476a989bea tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:20.653990 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f7299358-8280-4417-abb0-0e476a989bea tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:20.664875 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7299358-8280-4417-abb0-0e476a989bea tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:20.665633 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7299358-8280-4417-abb0-0e476a989bea tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:20.666683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7299358-8280-4417-abb0-0e476a989bea tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:20.667340 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f7299358-8280-4417-abb0-0e476a989bea tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:21.028998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f7299358-8280-4417-abb0-0e476a989bea tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:21.039740 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f7299358-8280-4417-abb0-0e476a989bea tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1366 microversion: 2.1 time: 0.391767 Jul 20 17:55:21.040325 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 371/753] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:20 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:21.635158 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:21.635774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:21.653352 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:21.653821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:21.654635 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:21.655072 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:21.906830 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-1fda1352-cc4d-488b-be2c-02eab0779e9c req-71ab4628-f3f2-4e33-b5b6-b308a97355f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb58a28d-f081-4f5b-8f8e-81883503f50b", "tag": "5c8e7455-3527-48af-b2d4-c650e2760d71"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:21.926047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:21.932401 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-1fda1352-cc4d-488b-be2c-02eab0779e9c req-71ab4628-f3f2-4e33-b5b6-b308a97355f2 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:21.935706 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-1fda1352-cc4d-488b-be2c-02eab0779e9c req-71ab4628-f3f2-4e33-b5b6-b308a97355f2 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:21.948958 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:21.950179 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-1fda1352-cc4d-488b-be2c-02eab0779e9c req-71ab4628-f3f2-4e33-b5b6-b308a97355f2 service nova] Creating event network-changed:5c8e7455-3527-48af-b2d4-c650e2760d71 for instance cb58a28d-f081-4f5b-8f8e-81883503f50b on hv-cinder-84984 Jul 20 17:55:21.950447 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:21.956557 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-1fda1352-cc4d-488b-be2c-02eab0779e9c req-71ab4628-f3f2-4e33-b5b6-b308a97355f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054267 Jul 20 17:55:21.956987 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7ea45642-47f6-4cb9-b423-81460151fe72 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.327276 Jul 20 17:55:21.957932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 372/754] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:55:21.968331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 383/755] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:21 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:22.060488 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-70640d82-0205-4b10-908a-190b17ed2c25 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:22.061191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-70640d82-0205-4b10-908a-190b17ed2c25 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:22.069906 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70640d82-0205-4b10-908a-190b17ed2c25 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:22.070623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70640d82-0205-4b10-908a-190b17ed2c25 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:22.071566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70640d82-0205-4b10-908a-190b17ed2c25 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:22.072875 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-70640d82-0205-4b10-908a-190b17ed2c25 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:22.391099 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-70640d82-0205-4b10-908a-190b17ed2c25 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:22.399987 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-70640d82-0205-4b10-908a-190b17ed2c25 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1366 microversion: 2.1 time: 0.344673 Jul 20 17:55:22.400938 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 373/756] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:22 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:22.982527 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:22.983140 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:22.989849 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:22.990242 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:22.990999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:22.991431 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:23.150513 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:23.158466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:23.159951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:23.161145 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-354b07f9-2dc3-4a11-9238-cee06cc0a8d0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.182544 Jul 20 17:55:23.162563 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 384/757] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:22 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:23.418383 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-acd88eb2-e2ae-440f-a566-ad38bf2dffe1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:23.418997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-acd88eb2-e2ae-440f-a566-ad38bf2dffe1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:23.426601 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-acd88eb2-e2ae-440f-a566-ad38bf2dffe1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:23.427065 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-acd88eb2-e2ae-440f-a566-ad38bf2dffe1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:23.427917 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-acd88eb2-e2ae-440f-a566-ad38bf2dffe1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:23.428399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-acd88eb2-e2ae-440f-a566-ad38bf2dffe1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:23.573664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-acd88eb2-e2ae-440f-a566-ad38bf2dffe1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:23.582124 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-acd88eb2-e2ae-440f-a566-ad38bf2dffe1 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1366 microversion: 2.1 time: 0.167888 Jul 20 17:55:23.584359 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 374/758] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:23 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:24.136195 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c4e80f29-abfb-4f77-b5b4-60bb6cee89f4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Action: 'create', calling method: .version_select at 0x7f7d3d6f3f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1477429252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKgGWm9Bv18rrxmsvyU2GBG4CiQ4BTozVVwRlFRvQkVLd/fg9B2UHPSvYhHDvIqH648Bx4AgU3kLKanb4J73AqjykoyTUdvGO34Wakstl3QYm+4owQipYMzwE5uKP3RtQ=="}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:24.150156 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-c4e80f29-abfb-4f77-b5b4-60bb6cee89f4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Getting quotas for project 863e2e49ffb74a889fb88c4c2e7edcd4. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:55:24.154177 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-c4e80f29-abfb-4f77-b5b4-60bb6cee89f4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Getting quotas for user 0fcc8275481e41f38bbdfac7db67b2e5 and project 863e2e49ffb74a889fb88c4c2e7edcd4. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:55:24.179580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:24.180251 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:24.186289 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:24.186740 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:24.187508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:24.187945 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:24.241337 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c4e80f29-abfb-4f77-b5b4-60bb6cee89f4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.321543 Jul 20 17:55:24.241943 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 385/759] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 17:55:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:24.322621 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:24.330557 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:24.332041 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:24.333224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d33fa08e-fb48-46c0-ad14-c40c515de3b7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.158142 Jul 20 17:55:24.333806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 375/760] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:24 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:55:24.599781 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a5a1b1d4-31aa-415f-8e5f-a2c3e0d82720 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:24.601635 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a5a1b1d4-31aa-415f-8e5f-a2c3e0d82720 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:24.607634 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a5a1b1d4-31aa-415f-8e5f-a2c3e0d82720 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:24.608162 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a5a1b1d4-31aa-415f-8e5f-a2c3e0d82720 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:24.609252 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a5a1b1d4-31aa-415f-8e5f-a2c3e0d82720 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:24.609713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a5a1b1d4-31aa-415f-8e5f-a2c3e0d82720 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:24.747574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a5a1b1d4-31aa-415f-8e5f-a2c3e0d82720 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:24.755314 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a5a1b1d4-31aa-415f-8e5f-a2c3e0d82720 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1366 microversion: 2.1 time: 0.159470 Jul 20 17:55:24.756073 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 386/761] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:24 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:25.352585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:25.353439 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:25.360754 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:25.361202 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:25.362123 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:25.362563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:25.698290 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:25.713063 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:25.715845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:25.719209 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ca5e598b-c82e-4ff2-86da-214b275c9854 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.371605 Jul 20 17:55:25.731035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 376/762] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:25 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:25.772947 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c7680c21-f37d-401e-a9af-3364cd99864e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:25.773709 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c7680c21-f37d-401e-a9af-3364cd99864e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:25.779858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c7680c21-f37d-401e-a9af-3364cd99864e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:25.780391 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c7680c21-f37d-401e-a9af-3364cd99864e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:25.781304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c7680c21-f37d-401e-a9af-3364cd99864e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:25.781700 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c7680c21-f37d-401e-a9af-3364cd99864e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:25.932828 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c7680c21-f37d-401e-a9af-3364cd99864e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:25.940674 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c7680c21-f37d-401e-a9af-3364cd99864e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1366 microversion: 2.1 time: 0.171343 Jul 20 17:55:25.950647 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 387/763] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:25 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:26.738869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:26.746750 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:26.765872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:26.768542 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=10 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:26.771465 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:26.772018 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:26.772853 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:26.773345 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:26.924692 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:26.934289 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:26.935796 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:26.937375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-73c42957-1f56-4217-82c5-55f178272e26 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.202297 Jul 20 17:55:26.939716 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 377/764] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:26 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:26.958195 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3b192b58-a71e-415b-afd4-620e6417b9c6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:26.962738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3b192b58-a71e-415b-afd4-620e6417b9c6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:26.967179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3b192b58-a71e-415b-afd4-620e6417b9c6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:26.967718 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3b192b58-a71e-415b-afd4-620e6417b9c6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:26.968597 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3b192b58-a71e-415b-afd4-620e6417b9c6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:26.969106 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3b192b58-a71e-415b-afd4-620e6417b9c6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:27.164261 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3b192b58-a71e-415b-afd4-620e6417b9c6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:27.174365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3b192b58-a71e-415b-afd4-620e6417b9c6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1366 microversion: 2.1 time: 0.220322 Jul 20 17:55:27.175430 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 388/765] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:26 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:27.694952 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-6e8ed226-d44c-4689-b83b-7cc378ec17f1 req-af768686-daa6-4dd4-ab3c-89b7ef240d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb58a28d-f081-4f5b-8f8e-81883503f50b", "name": "network-vif-plugged", "status": "completed", "tag": "5c8e7455-3527-48af-b2d4-c650e2760d71"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:27.703201 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6e8ed226-d44c-4689-b83b-7cc378ec17f1 req-af768686-daa6-4dd4-ab3c-89b7ef240d53 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:27.703648 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6e8ed226-d44c-4689-b83b-7cc378ec17f1 req-af768686-daa6-4dd4-ab3c-89b7ef240d53 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:27.718512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-6e8ed226-d44c-4689-b83b-7cc378ec17f1 req-af768686-daa6-4dd4-ab3c-89b7ef240d53 service nova] Creating event network-vif-plugged:5c8e7455-3527-48af-b2d4-c650e2760d71 for instance cb58a28d-f081-4f5b-8f8e-81883503f50b on hv-cinder-84984 Jul 20 17:55:27.723083 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-6e8ed226-d44c-4689-b83b-7cc378ec17f1 req-af768686-daa6-4dd4-ab3c-89b7ef240d53 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097490 Jul 20 17:55:27.723679 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 378/766] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:27.961097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:27.962189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:27.969667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:27.970244 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:27.971082 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:27.971584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:28.102905 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:28.110842 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:28.112342 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:28.113531 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-317445ad-33cc-422c-a7f6-029483a78ff7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1742 microversion: 2.20 time: 0.160009 Jul 20 17:55:28.114091 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 389/767] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:27 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:28.192392 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4ccd8973-973d-41f4-9e38-fd184eb21715 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:28.193130 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4ccd8973-973d-41f4-9e38-fd184eb21715 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:28.200124 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ccd8973-973d-41f4-9e38-fd184eb21715 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:28.200547 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ccd8973-973d-41f4-9e38-fd184eb21715 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:28.201318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ccd8973-973d-41f4-9e38-fd184eb21715 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:28.201753 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ccd8973-973d-41f4-9e38-fd184eb21715 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:28.362167 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4ccd8973-973d-41f4-9e38-fd184eb21715 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:28.370257 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4ccd8973-973d-41f4-9e38-fd184eb21715 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1366 microversion: 2.1 time: 0.182819 Jul 20 17:55:28.370804 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 379/768] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:28 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:29.132319 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:29.133017 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:29.139472 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:29.139927 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:29.140727 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:29.141167 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:29.271045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:29.280041 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:29.285191 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:29.285191 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-916de483-c69f-4260-95ff-1182eb3ca381 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1742 microversion: 2.20 time: 0.154396 Jul 20 17:55:29.285191 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 390/769] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:29 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:29.387828 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8569c76b-c4a9-426e-b74a-6c7b3a722730 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:29.388450 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8569c76b-c4a9-426e-b74a-6c7b3a722730 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:29.394774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8569c76b-c4a9-426e-b74a-6c7b3a722730 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:29.395216 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8569c76b-c4a9-426e-b74a-6c7b3a722730 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:29.395965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8569c76b-c4a9-426e-b74a-6c7b3a722730 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:29.396391 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8569c76b-c4a9-426e-b74a-6c7b3a722730 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:29.534196 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8569c76b-c4a9-426e-b74a-6c7b3a722730 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:29.542035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8569c76b-c4a9-426e-b74a-6c7b3a722730 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1366 microversion: 2.1 time: 0.158057 Jul 20 17:55:29.542664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 380/770] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:29 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:30.301047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:30.301669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:30.308780 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:30.309239 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:30.310033 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:30.310475 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:30.444459 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:30.452542 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:30.455606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:30.455606 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-bdfaecaa-5146-446c-ab38-ec3fcb39b40a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1742 microversion: 2.20 time: 0.158145 Jul 20 17:55:30.455827 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 391/771] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:30 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:30.559105 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7487e131-1728-4a00-9290-b8b2374329eb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:30.559720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7487e131-1728-4a00-9290-b8b2374329eb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:30.566601 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7487e131-1728-4a00-9290-b8b2374329eb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:30.567054 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7487e131-1728-4a00-9290-b8b2374329eb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:30.567831 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7487e131-1728-4a00-9290-b8b2374329eb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:30.568384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7487e131-1728-4a00-9290-b8b2374329eb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:30.697852 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7487e131-1728-4a00-9290-b8b2374329eb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:30.705480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7487e131-1728-4a00-9290-b8b2374329eb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1556 microversion: 2.1 time: 0.150311 Jul 20 17:55:30.706045 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 381/772] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:30 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:30.722295 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7087b4a4-c708-4ca0-8a20-edb65a8c486e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:30.722792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7087b4a4-c708-4ca0-8a20-edb65a8c486e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:30.729338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7087b4a4-c708-4ca0-8a20-edb65a8c486e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:30.729927 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7087b4a4-c708-4ca0-8a20-edb65a8c486e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:30.730610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7087b4a4-c708-4ca0-8a20-edb65a8c486e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:30.731041 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7087b4a4-c708-4ca0-8a20-edb65a8c486e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:30.814041 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7087b4a4-c708-4ca0-8a20-edb65a8c486e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095699 Jul 20 17:55:30.814634 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 392/773] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jul 20 17:55:30 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:31.433501 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-b6003ea8-7101-43fb-9080-28507678565a req-88ac1e3c-cf98-4eff-8dd0-07d2c54938d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e70e71-0f97-4e13-8c1b-88944978cb60", "name": "network-vif-plugged", "status": "completed", "tag": "c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:31.445976 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-b6003ea8-7101-43fb-9080-28507678565a req-88ac1e3c-cf98-4eff-8dd0-07d2c54938d1 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:31.446410 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-b6003ea8-7101-43fb-9080-28507678565a req-88ac1e3c-cf98-4eff-8dd0-07d2c54938d1 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:31.450564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:31.457904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-b6003ea8-7101-43fb-9080-28507678565a req-88ac1e3c-cf98-4eff-8dd0-07d2c54938d1 service nova] Creating event network-vif-plugged:c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9 for instance 08e70e71-0f97-4e13-8c1b-88944978cb60 on hv-cinder-84984 Jul 20 17:55:31.472127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-b6003ea8-7101-43fb-9080-28507678565a req-88ac1e3c-cf98-4eff-8dd0-07d2c54938d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043367 Jul 20 17:55:31.473551 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 382/774] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:55:31.474954 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:31.476144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:31.483146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:31.483794 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:31.484780 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:31.485416 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:31.964820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:31.973028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:31.974531 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:31.975951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b158b1b5-d354-4da7-94d7-66a19d12e5d9 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.505210 Jul 20 17:55:31.986969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 393/775] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:31 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:32.184717 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-6a1e126c-e714-4536-a20d-486773b5fe5a req-f5e82f8b-51f3-4bc0-b7df-77e8ae5afbac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb58a28d-f081-4f5b-8f8e-81883503f50b", "tag": "5c8e7455-3527-48af-b2d4-c650e2760d71"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:32.199699 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6a1e126c-e714-4536-a20d-486773b5fe5a req-f5e82f8b-51f3-4bc0-b7df-77e8ae5afbac service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:32.200362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6a1e126c-e714-4536-a20d-486773b5fe5a req-f5e82f8b-51f3-4bc0-b7df-77e8ae5afbac service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:32.214997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-6a1e126c-e714-4536-a20d-486773b5fe5a req-f5e82f8b-51f3-4bc0-b7df-77e8ae5afbac service nova] Creating event network-changed:5c8e7455-3527-48af-b2d4-c650e2760d71 for instance cb58a28d-f081-4f5b-8f8e-81883503f50b on hv-cinder-84984 Jul 20 17:55:32.220067 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-6a1e126c-e714-4536-a20d-486773b5fe5a req-f5e82f8b-51f3-4bc0-b7df-77e8ae5afbac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040682 Jul 20 17:55:32.220978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 383/776] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:33.001893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:33.002510 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:33.014727 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:33.017362 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:33.021118 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:33.023820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:33.277482 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:33.286076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:33.292308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:33.293709 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2c89db75-de83-4fb3-88c4-83db47331cef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.302659 Jul 20 17:55:33.296473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 394/777] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:32 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:34.315186 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:34.316289 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:34.324193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:34.324922 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:34.325932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:34.326551 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:34.521982 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:34.531558 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:34.533344 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:34.534729 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-abaef449-a7b2-42bf-961b-740fbb220d68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.226241 Jul 20 17:55:34.535269 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 384/778] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:34 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:55:35.552820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:35.554021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:35.556595 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=8 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:35.562479 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:35.563272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:35.564035 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:35.564479 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:35.715000 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:35.723457 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:35.725009 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:35.726968 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6bce36e6-1591-4260-9ffc-b8bd19808737 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.178244 Jul 20 17:55:35.727810 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 395/779] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:35 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:36.745912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:36.747181 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:36.754568 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:36.755250 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:36.756326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:36.756698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:36.901696 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:36.910991 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:36.912586 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:36.914707 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-87d2be81-1c5c-476c-9c15-82b89cee344e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.173297 Jul 20 17:55:36.915585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 385/780] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:36 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:37.934120 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:37.934880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:37.942186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:37.942678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:37.943510 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:37.943959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:37.948388 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=100 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:38.083858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:38.092787 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:38.094313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:38.095478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-545f2474-9175-44fc-876e-2768babc5cfc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.165667 Jul 20 17:55:38.096081 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 396/781] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:37 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:39.115742 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:39.117272 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:39.124285 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:39.124834 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:39.125981 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:39.126495 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:39.288178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:39.297269 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:39.299312 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:39.300776 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ab46bb9b-dffe-4a2f-a609-bbde8b659227 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.189051 Jul 20 17:55:39.301505 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 386/782] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:39 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:39.896127 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-da173ab3-6b6e-4d55-88a9-429faacc8361 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:39.897349 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-da173ab3-6b6e-4d55-88a9-429faacc8361 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:39.907130 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da173ab3-6b6e-4d55-88a9-429faacc8361 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:39.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da173ab3-6b6e-4d55-88a9-429faacc8361 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:39.909177 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da173ab3-6b6e-4d55-88a9-429faacc8361 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:39.910108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-da173ab3-6b6e-4d55-88a9-429faacc8361 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:40.017390 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-da173ab3-6b6e-4d55-88a9-429faacc8361 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'services' on Instance uuid 134b17e0-3dcb-4586-9810-065cd7ec4243 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:55:40.222740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-da173ab3-6b6e-4d55-88a9-429faacc8361 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "DELETE /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments/9c4a9fdb-1bbb-402e-ac95-dc451e5abef2" status: 202 len: 0 microversion: 2.1 time: 0.330328 Jul 20 17:55:40.226827 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 397/783] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:55:39 2022] DELETE /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments/9c4a9fdb-1bbb-402e-ac95-dc451e5abef2 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:55:40.233875 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cd222900-337f-4f88-adc4-23fb971ecb44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:40.235195 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cd222900-337f-4f88-adc4-23fb971ecb44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:40.243246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd222900-337f-4f88-adc4-23fb971ecb44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:40.243967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd222900-337f-4f88-adc4-23fb971ecb44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:40.244857 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd222900-337f-4f88-adc4-23fb971ecb44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:40.245555 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cd222900-337f-4f88-adc4-23fb971ecb44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:40.278484 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cd222900-337f-4f88-adc4-23fb971ecb44 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050258 Jul 20 17:55:40.279447 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 387/784] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:55:40 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:55:40.320156 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:40.320998 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:40.331587 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:40.332532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:40.333404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:40.333915 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:40.502722 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:40.511328 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:40.512939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:40.514556 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6ace130e-8e14-4635-8b36-2ce025b446d7 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.199392 Jul 20 17:55:40.525042 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 398/785] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:40 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:41.291765 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c3634bd8-7610-4a2e-a2fd-5a140c6db449 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:41.292970 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c3634bd8-7610-4a2e-a2fd-5a140c6db449 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:41.299487 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3634bd8-7610-4a2e-a2fd-5a140c6db449 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:41.299934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3634bd8-7610-4a2e-a2fd-5a140c6db449 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:41.300728 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3634bd8-7610-4a2e-a2fd-5a140c6db449 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:41.301161 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c3634bd8-7610-4a2e-a2fd-5a140c6db449 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:41.332349 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c3634bd8-7610-4a2e-a2fd-5a140c6db449 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Jul 20 17:55:41.333095 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 388/786] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:55:41 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:41.532076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:41.532705 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:41.541241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:41.541689 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:41.542502 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:41.542877 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:41.707939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:41.716573 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:41.717951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:41.719103 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2b612772-2d8c-4122-b0a8-741aeaa9bfe6 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.190898 Jul 20 17:55:41.719825 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 399/787] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:41 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:42.343319 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-188627f0-10dc-4a6e-8cc9-add9642f86ee tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:42.344925 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-188627f0-10dc-4a6e-8cc9-add9642f86ee tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:42.352129 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-188627f0-10dc-4a6e-8cc9-add9642f86ee tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:42.352536 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-188627f0-10dc-4a6e-8cc9-add9642f86ee tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:42.353300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-188627f0-10dc-4a6e-8cc9-add9642f86ee tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:42.353849 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-188627f0-10dc-4a6e-8cc9-add9642f86ee tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:42.386268 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-188627f0-10dc-4a6e-8cc9-add9642f86ee tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046791 Jul 20 17:55:42.386862 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 389/788] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:55:42 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 17:55:42.459131 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c0f0a49d-71a5-4919-9d78-f3b0840324f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:42.459645 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c0f0a49d-71a5-4919-9d78-f3b0840324f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:42.466415 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c0f0a49d-71a5-4919-9d78-f3b0840324f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:42.466859 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c0f0a49d-71a5-4919-9d78-f3b0840324f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:42.467653 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c0f0a49d-71a5-4919-9d78-f3b0840324f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:42.468081 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c0f0a49d-71a5-4919-9d78-f3b0840324f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:42.499325 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c0f0a49d-71a5-4919-9d78-f3b0840324f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:55:42.738194 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:42.738807 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:42.745452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:42.745909 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:42.746655 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:42.747089 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:42.805446 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c0f0a49d-71a5-4919-9d78-f3b0840324f0 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "DELETE /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 204 len: 0 microversion: 2.1 time: 0.350061 Jul 20 17:55:42.806163 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 400/789] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:55:42 2022] DELETE /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:55:42.814268 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-934a7849-b628-4fc1-b82b-f453f3ded2a4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:42.814951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-934a7849-b628-4fc1-b82b-f453f3ded2a4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:42.821232 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-934a7849-b628-4fc1-b82b-f453f3ded2a4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:42.821678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-934a7849-b628-4fc1-b82b-f453f3ded2a4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:42.822430 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-934a7849-b628-4fc1-b82b-f453f3ded2a4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:42.822858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-934a7849-b628-4fc1-b82b-f453f3ded2a4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:42.920918 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:42.929421 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:42.930932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:42.932101 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4f548818-de4e-406f-a104-80423cb30afe tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.199037 Jul 20 17:55:42.932690 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 390/790] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:42 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:55:42.977453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-934a7849-b628-4fc1-b82b-f453f3ded2a4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:42.984802 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-934a7849-b628-4fc1-b82b-f453f3ded2a4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1689 microversion: 2.1 time: 0.174570 Jul 20 17:55:42.985364 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 401/791] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:42 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:43.950734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:43.951339 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:43.958098 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:43.958542 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:43.959292 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:43.960240 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:44.002198 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-357a549d-92ab-44c9-8981-2a39dcae3d95 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:44.002902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-357a549d-92ab-44c9-8981-2a39dcae3d95 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:44.009393 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-357a549d-92ab-44c9-8981-2a39dcae3d95 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:44.009921 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-357a549d-92ab-44c9-8981-2a39dcae3d95 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:44.010753 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-357a549d-92ab-44c9-8981-2a39dcae3d95 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:44.011258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-357a549d-92ab-44c9-8981-2a39dcae3d95 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:44.141809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:44.150524 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:44.152022 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:44.153204 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a4728e9f-8306-428d-924d-628781136b3e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.206451 Jul 20 17:55:44.153756 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 391/792] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:43 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:44.171856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-357a549d-92ab-44c9-8981-2a39dcae3d95 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:44.179331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-357a549d-92ab-44c9-8981-2a39dcae3d95 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1689 microversion: 2.1 time: 0.181108 Jul 20 17:55:44.179897 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 402/793] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:43 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:44.799609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-463687059", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1477429252", "security_groups": [{"name": "tempest-secgroup-smoke-131608519"}], "networks": [{"uuid": "3f57c44c-778f-4bc1-93a2-a0a8e3568860"}], "block_device_mapping_v2": [{"uuid": "9e6a8885-1a43-4b7c-ba77-fd94b0035aa2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:44.908874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] validate_networks() for [('3f57c44c-778f-4bc1-93a2-a0a8e3568860', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:55:45.171865 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:45.172529 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:45.179486 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:45.179933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:45.180718 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:45.181147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:45.331919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:55:45.332408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:55:45.332985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:55:45.333504 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:55:45.333941 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:55:45.343388 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:45.343839 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:45.344682 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:45.345122 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:45.362089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:45.362393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Getting quotas for project 863e2e49ffb74a889fb88c4c2e7edcd4. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:55:45.366588 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Getting quotas for user 0fcc8275481e41f38bbdfac7db67b2e5 and project 863e2e49ffb74a889fb88c4c2e7edcd4. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:55:45.369888 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:45.371372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:45.372539 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-60819fee-06e6-4365-92a8-829e1f4d320e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.204578 Jul 20 17:55:45.373401 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 403/794] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:45 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:55:45.377673 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fc8b16ab-33a6-498d-b57f-d55b5c53561a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:45.378268 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fc8b16ab-33a6-498d-b57f-d55b5c53561a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:45.384111 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fc8b16ab-33a6-498d-b57f-d55b5c53561a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:45.384662 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fc8b16ab-33a6-498d-b57f-d55b5c53561a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:45.385422 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fc8b16ab-33a6-498d-b57f-d55b5c53561a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:45.385865 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fc8b16ab-33a6-498d-b57f-d55b5c53561a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:45.423756 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:55:45.426007 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e6a8885-1a43-4b7c-ba77-fd94b0035aa2',volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:55:45.518064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fc8b16ab-33a6-498d-b57f-d55b5c53561a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:45.526017 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fc8b16ab-33a6-498d-b57f-d55b5c53561a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1689 microversion: 2.1 time: 0.151814 Jul 20 17:55:45.526575 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 404/795] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:45 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:45.955555 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c20db08b-e1dd-4527-8cfa-6bd3812b5cae tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.159723 Jul 20 17:55:45.956178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 392/796] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:55:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:55:45.966542 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3c87ea7e-a118-44c5-a245-759009e930f7 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:45.967250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3c87ea7e-a118-44c5-a245-759009e930f7 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:46.020505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3c87ea7e-a118-44c5-a245-759009e930f7 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:46.027070 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3c87ea7e-a118-44c5-a245-759009e930f7 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1088 microversion: 2.1 time: 0.064320 Jul 20 17:55:46.027637 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 405/797] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:45 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:46.391269 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:46.391914 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:46.393887 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:46.399430 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:46.400305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:46.401127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:46.401561 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:46.543252 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-81825aa4-9e8f-4536-951f-d030307a8372 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:46.544648 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-81825aa4-9e8f-4536-951f-d030307a8372 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:46.552154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81825aa4-9e8f-4536-951f-d030307a8372 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:46.552634 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81825aa4-9e8f-4536-951f-d030307a8372 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:46.553621 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81825aa4-9e8f-4536-951f-d030307a8372 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:46.554257 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81825aa4-9e8f-4536-951f-d030307a8372 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:46.572809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:46.581085 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:46.582669 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:46.583919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5fc01971-e486-49b2-8300-e5ecb736611b tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1737 microversion: 2.20 time: 0.197161 Jul 20 17:55:46.584576 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 393/798] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:46 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:46.696081 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-81825aa4-9e8f-4536-951f-d030307a8372 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:46.705235 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-81825aa4-9e8f-4536-951f-d030307a8372 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1689 microversion: 2.1 time: 0.165969 Jul 20 17:55:46.706061 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 406/799] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:46 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:47.043667 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f548f73d-384a-4b74-af50-4d33520f9e28 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:47.044311 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f548f73d-384a-4b74-af50-4d33520f9e28 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:47.054562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f548f73d-384a-4b74-af50-4d33520f9e28 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:47.055610 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f548f73d-384a-4b74-af50-4d33520f9e28 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:47.056018 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f548f73d-384a-4b74-af50-4d33520f9e28 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:47.056575 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f548f73d-384a-4b74-af50-4d33520f9e28 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:47.129715 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f548f73d-384a-4b74-af50-4d33520f9e28 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:47.138101 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f548f73d-384a-4b74-af50-4d33520f9e28 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1138 microversion: 2.1 time: 0.098640 Jul 20 17:55:47.138908 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 394/800] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:47 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1138 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:47.599327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-545d7f51-d772-43cb-98fb-628c42867022 req-116349ed-75a1-4d84-9cd2-b0b07f2e7e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134b17e0-3dcb-4586-9810-065cd7ec4243", "name": "network-vif-deleted", "tag": "3ed31386-5e58-4b1f-be48-e5bcbda66a7d"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:47.603122 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:47.603805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:47.609095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-545d7f51-d772-43cb-98fb-628c42867022 req-116349ed-75a1-4d84-9cd2-b0b07f2e7e44 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:47.609649 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-545d7f51-d772-43cb-98fb-628c42867022 req-116349ed-75a1-4d84-9cd2-b0b07f2e7e44 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:47.610003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:47.610806 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:47.611605 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:47.612094 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:47.621057 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-545d7f51-d772-43cb-98fb-628c42867022 req-116349ed-75a1-4d84-9cd2-b0b07f2e7e44 service nova] Creating event network-vif-deleted:3ed31386-5e58-4b1f-be48-e5bcbda66a7d for instance 134b17e0-3dcb-4586-9810-065cd7ec4243 on hv-cinder-84984 Jul 20 17:55:47.626413 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-545d7f51-d772-43cb-98fb-628c42867022 req-116349ed-75a1-4d84-9cd2-b0b07f2e7e44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032631 Jul 20 17:55:47.627115 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 407/801] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:47.730993 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-63ef6d6b-359b-46b2-9771-e90d81438b67 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:47.732034 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-63ef6d6b-359b-46b2-9771-e90d81438b67 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:47.739584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-63ef6d6b-359b-46b2-9771-e90d81438b67 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:47.739584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-63ef6d6b-359b-46b2-9771-e90d81438b67 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:47.740611 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-63ef6d6b-359b-46b2-9771-e90d81438b67 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:47.741176 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-63ef6d6b-359b-46b2-9771-e90d81438b67 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:47.756303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:47.764789 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:47.766614 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:47.768075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9f4590e4-9b45-4281-a451-9ccc94a3e1d8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1719 microversion: 2.20 time: 0.169908 Jul 20 17:55:47.769205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 395/802] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:47 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:55:47.820285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-63ef6d6b-359b-46b2-9771-e90d81438b67 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:47.828271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-63ef6d6b-359b-46b2-9771-e90d81438b67 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1621 microversion: 2.1 time: 0.102944 Jul 20 17:55:47.829217 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 408/803] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:47 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1621 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:48.155213 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-27980c00-f698-4e25-942c-6198adc54dd9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:48.155958 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-27980c00-f698-4e25-942c-6198adc54dd9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:48.162047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-27980c00-f698-4e25-942c-6198adc54dd9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:48.162501 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-27980c00-f698-4e25-942c-6198adc54dd9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:48.163271 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-27980c00-f698-4e25-942c-6198adc54dd9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:48.163712 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-27980c00-f698-4e25-942c-6198adc54dd9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:48.461981 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-27980c00-f698-4e25-942c-6198adc54dd9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:48.469848 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-27980c00-f698-4e25-942c-6198adc54dd9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1130 microversion: 2.1 time: 0.318545 Jul 20 17:55:48.470425 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 396/804] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:48 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1130 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:48.787446 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:48.788780 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:48.796363 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:48.802892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:48.802892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:48.802892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:48.845759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ed80057f-2f89-4a12-a0ab-4f6f5b9ab082 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:48.846856 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ed80057f-2f89-4a12-a0ab-4f6f5b9ab082 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:48.859538 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed80057f-2f89-4a12-a0ab-4f6f5b9ab082 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:48.859978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed80057f-2f89-4a12-a0ab-4f6f5b9ab082 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:48.862670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed80057f-2f89-4a12-a0ab-4f6f5b9ab082 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:48.862670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed80057f-2f89-4a12-a0ab-4f6f5b9ab082 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:48.936597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ed80057f-2f89-4a12-a0ab-4f6f5b9ab082 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:48.945422 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ed80057f-2f89-4a12-a0ab-4f6f5b9ab082 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1330 microversion: 2.1 time: 0.103646 Jul 20 17:55:48.946003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 397/805] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:48 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:48.983951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:48.993869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:48.996050 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:48.997562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f9cd28d3-ac13-4f40-9297-46ecf0a6d69a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1719 microversion: 2.20 time: 0.214159 Jul 20 17:55:48.998124 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 409/806] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:48 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:49.482065 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-33af822d-e957-4cae-a76a-b9a7613e069c req-c1375370-0f09-4d96-a4da-786e2709e554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e70e71-0f97-4e13-8c1b-88944978cb60", "name": "network-vif-unplugged", "status": "completed", "tag": "c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:49.486085 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5cb43314-19d4-4257-a8c1-37f508a3a1ca tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:49.486765 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5cb43314-19d4-4257-a8c1-37f508a3a1ca tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:49.492026 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-33af822d-e957-4cae-a76a-b9a7613e069c req-c1375370-0f09-4d96-a4da-786e2709e554 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:49.492648 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-33af822d-e957-4cae-a76a-b9a7613e069c req-c1375370-0f09-4d96-a4da-786e2709e554 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:49.497553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5cb43314-19d4-4257-a8c1-37f508a3a1ca tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:49.497553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5cb43314-19d4-4257-a8c1-37f508a3a1ca tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:49.497553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5cb43314-19d4-4257-a8c1-37f508a3a1ca tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:49.497553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5cb43314-19d4-4257-a8c1-37f508a3a1ca tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:49.503834 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-33af822d-e957-4cae-a76a-b9a7613e069c req-c1375370-0f09-4d96-a4da-786e2709e554 service nova] Creating event network-vif-unplugged:c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9 for instance 08e70e71-0f97-4e13-8c1b-88944978cb60 on hv-cinder-84984 Jul 20 17:55:49.509407 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-33af822d-e957-4cae-a76a-b9a7613e069c req-c1375370-0f09-4d96-a4da-786e2709e554 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031370 Jul 20 17:55:49.509996 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 398/807] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:49.558713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5cb43314-19d4-4257-a8c1-37f508a3a1ca tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:49.570320 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5cb43314-19d4-4257-a8c1-37f508a3a1ca tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1186 microversion: 2.1 time: 0.087959 Jul 20 17:55:49.570908 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 410/808] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:49 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:49.963890 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:49.964618 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:49.971301 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:49.971744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:49.972531 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:49.972967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:50.009758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:50.010462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:50.015174 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:50.015787 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:50.018464 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:50.020620 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid 134b17e0-3dcb-4586-9810-065cd7ec4243 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:55:50.024914 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:50.026969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:50.026969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:50.026969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:50.080117 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:50.088055 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ec538f95-1df1-4b8b-9420-b34730c79dc4 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 200 len: 1335 microversion: 2.1 time: 0.128330 Jul 20 17:55:50.088572 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 399/809] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:49 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:50.246527 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:50.265804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:50.267326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:50.270026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fc8d28f6-4e31-4831-b014-21c45d373540 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1722 microversion: 2.20 time: 0.257975 Jul 20 17:55:50.271809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 411/810] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:50 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:55:50.290626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0935215b-5bd2-4e06-bd90-4e2b12c49e3f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e286142-7cb9-4b93-b50d-8485793e031b"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:50.292035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0935215b-5bd2-4e06-bd90-4e2b12c49e3f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:50.299987 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0935215b-5bd2-4e06-bd90-4e2b12c49e3f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:50.300782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0935215b-5bd2-4e06-bd90-4e2b12c49e3f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:50.301597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0935215b-5bd2-4e06-bd90-4e2b12c49e3f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:50.302041 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0935215b-5bd2-4e06-bd90-4e2b12c49e3f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:50.382452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=100 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:50.589004 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6b853dfb-4f12-475b-9523-5a9081b88da8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:50.589619 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6b853dfb-4f12-475b-9523-5a9081b88da8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:50.596208 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6b853dfb-4f12-475b-9523-5a9081b88da8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:50.596692 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6b853dfb-4f12-475b-9523-5a9081b88da8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:50.597455 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6b853dfb-4f12-475b-9523-5a9081b88da8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:50.597894 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6b853dfb-4f12-475b-9523-5a9081b88da8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:50.603834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:50.674828 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6b853dfb-4f12-475b-9523-5a9081b88da8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:50.681624 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6b853dfb-4f12-475b-9523-5a9081b88da8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1204 microversion: 2.1 time: 0.097090 Jul 20 17:55:50.682197 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 412/811] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:50 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:51.105541 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:51.106538 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 134b17e0-3dcb-4586-9810-065cd7ec4243] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:51.117207 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:51.117737 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:51.118600 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:51.119098 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:51.134188 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] HTTP exception thrown: Instance 134b17e0-3dcb-4586-9810-065cd7ec4243 could not be found. Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Request method failure captured: Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 HTTP/1.1 Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2ECFR8Chf_-oC5r4ltXJ63KUnxvQuEmcxamgLZkPzUQBaz6u_DRxVxJh81w11ssb1D_5EnfdMiUucEa-pyrvFRYV06pWwIIiHHbWBmycepP5B806CKpRGnYDA__HD_ppgbQ3YrlOygxDiDxAFTS3iVoixCYUCzSkehzwaC58aAjvgvc Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:55:51.135912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bde6b55e64864d188ee5fafc4b9edc4a"}]}] Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 8daac4acc2fb4d47a7549ef710a70fca Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 134b17e0-3dcb-4586-9810-065cd7ec4243 could not be found. Jul 20 17:55:51.137703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '134b17e0-3dcb-4586-9810-065cd7ec4243'} Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134b17e0-3dcb-4586-9810-065cd7ec4243 could not be found. Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:55:51.138596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134b17e0-3dcb-4586-9810-065cd7ec4243 could not be found. Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134b17e0-3dcb-4586-9810-065cd7ec4243 could not be found. Jul 20 17:55:51.140078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:55:51.141405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Returning 404 to user: Instance 134b17e0-3dcb-4586-9810-065cd7ec4243 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:55:51.141405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-bb05080f-f5d6-436c-8e3d-8428b3204e85 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243" status: 404 len: 111 microversion: 2.1 time: 0.038650 Jul 20 17:55:51.141405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 413/812] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:51 2022] GET /compute/v2.1/servers/134b17e0-3dcb-4586-9810-065cd7ec4243 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 17:55:51.149328 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a1089bc2-c9ec-44bd-be4c-be629453e224 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '.version_select at 0x7f7d3d6a8a60>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:51.218815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a1089bc2-c9ec-44bd-be4c-be629453e224 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501291331" status: 202 len: 0 microversion: 2.1 time: 0.073313 Jul 20 17:55:51.219089 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 414/813] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jul 20 17:55:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501291331 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 17:55:51.519904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0935215b-5bd2-4e06-bd90-4e2b12c49e3f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.235044 Jul 20 17:55:51.520574 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 400/814] 10.222.0.42 () {62 vars in 1363 bytes} [Wed Jul 20 17:55:50 2022] POST /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/os-volume_attachments => generated 188 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 17:55:51.663457 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7d12ec7a-f02d-43e2-b76a-e412cab514ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:51.663994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7d12ec7a-f02d-43e2-b76a-e412cab514ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:51.672263 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d12ec7a-f02d-43e2-b76a-e412cab514ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:51.672738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d12ec7a-f02d-43e2-b76a-e412cab514ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:51.673507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d12ec7a-f02d-43e2-b76a-e412cab514ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:51.673932 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d12ec7a-f02d-43e2-b76a-e412cab514ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:51.699700 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-96da8c7e-b485-4400-90b8-dfdc58ca78ec tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:51.700427 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-96da8c7e-b485-4400-90b8-dfdc58ca78ec tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:51.707660 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-96da8c7e-b485-4400-90b8-dfdc58ca78ec tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:51.712997 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-96da8c7e-b485-4400-90b8-dfdc58ca78ec tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:51.714378 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-96da8c7e-b485-4400-90b8-dfdc58ca78ec tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:51.715028 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-96da8c7e-b485-4400-90b8-dfdc58ca78ec tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:51.980462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-96da8c7e-b485-4400-90b8-dfdc58ca78ec tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:51.989957 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-96da8c7e-b485-4400-90b8-dfdc58ca78ec tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1271 microversion: 2.1 time: 0.294253 Jul 20 17:55:51.990580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 401/815] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:51 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1271 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:52.177606 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-fd672a69-11ba-488e-92b3-5649f783b5cc req-cc9d5a2a-cf6a-463d-9f9e-343be7fb2966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940b1e17-6334-434f-a6f4-ea98310e44f9", "tag": "0d2efd3e-013a-4a3b-bc60-84e6553804e3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:52.217652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-fd672a69-11ba-488e-92b3-5649f783b5cc req-cc9d5a2a-cf6a-463d-9f9e-343be7fb2966 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:52.219426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-fd672a69-11ba-488e-92b3-5649f783b5cc req-cc9d5a2a-cf6a-463d-9f9e-343be7fb2966 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:52.232738 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-fd672a69-11ba-488e-92b3-5649f783b5cc req-cc9d5a2a-cf6a-463d-9f9e-343be7fb2966 service nova] Creating event network-changed:0d2efd3e-013a-4a3b-bc60-84e6553804e3 for instance 940b1e17-6334-434f-a6f4-ea98310e44f9 on hv-cinder-84984 Jul 20 17:55:52.238597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-fd672a69-11ba-488e-92b3-5649f783b5cc req-cc9d5a2a-cf6a-463d-9f9e-343be7fb2966 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073486 Jul 20 17:55:52.239466 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 402/816] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:52.335843 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7d12ec7a-f02d-43e2-b76a-e412cab514ed tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/os-volume_attachments/5e286142-7cb9-4b93-b50d-8485793e031b" status: 202 len: 0 microversion: 2.20 time: 0.676705 Jul 20 17:55:52.336475 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 415/817] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jul 20 17:55:51 2022] DELETE /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/os-volume_attachments/5e286142-7cb9-4b93-b50d-8485793e031b => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:55:52.405888 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ff16c97d-6367-4896-afef-65ddc9c35321 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:52.406898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ff16c97d-6367-4896-afef-65ddc9c35321 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:52.422140 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ff16c97d-6367-4896-afef-65ddc9c35321 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:52.422612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ff16c97d-6367-4896-afef-65ddc9c35321 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:52.424457 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ff16c97d-6367-4896-afef-65ddc9c35321 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:52.424940 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ff16c97d-6367-4896-afef-65ddc9c35321 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:52.946369 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ff16c97d-6367-4896-afef-65ddc9c35321 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "POST /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/action" status: 202 len: 0 microversion: 2.20 time: 0.546009 Jul 20 17:55:52.950245 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 403/818] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jul 20 17:55:52 2022] POST /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:55:52.956949 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:52.957708 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:52.964981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:52.965431 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:52.966187 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:52.966617 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:53.008047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3774aeec-149a-459e-bb9c-b54cf0125756 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:53.008747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3774aeec-149a-459e-bb9c-b54cf0125756 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:53.015826 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3774aeec-149a-459e-bb9c-b54cf0125756 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:53.016273 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3774aeec-149a-459e-bb9c-b54cf0125756 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:53.019463 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3774aeec-149a-459e-bb9c-b54cf0125756 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:53.019463 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3774aeec-149a-459e-bb9c-b54cf0125756 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:53.163220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:53.175242 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:53.180335 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:53.181667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-45918bad-2a13-40b5-a85f-2c87bb5b7625 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1670 microversion: 2.20 time: 0.229583 Jul 20 17:55:53.182410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 416/819] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:52 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:53.198096 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3774aeec-149a-459e-bb9c-b54cf0125756 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:53.203632 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3774aeec-149a-459e-bb9c-b54cf0125756 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.200206 Jul 20 17:55:53.204191 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 404/820] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:53 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:54.200093 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:54.200742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:54.207154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:54.207612 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:54.208351 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:54.208877 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:54.222043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0fd79a26-75c6-41fd-b7b1-0b7bfa848ba2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:54.222592 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0fd79a26-75c6-41fd-b7b1-0b7bfa848ba2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:54.229198 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fd79a26-75c6-41fd-b7b1-0b7bfa848ba2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:54.229689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fd79a26-75c6-41fd-b7b1-0b7bfa848ba2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:54.230528 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fd79a26-75c6-41fd-b7b1-0b7bfa848ba2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:54.230965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0fd79a26-75c6-41fd-b7b1-0b7bfa848ba2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:54.395518 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:54.403486 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:54.405014 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:54.406300 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-581e5faf-632b-4aa6-92f0-b4102e7708dd tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1670 microversion: 2.20 time: 0.210002 Jul 20 17:55:54.416996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 417/821] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:54 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1670 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:54.420842 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0fd79a26-75c6-41fd-b7b1-0b7bfa848ba2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:54.428208 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0fd79a26-75c6-41fd-b7b1-0b7bfa848ba2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.210213 Jul 20 17:55:54.429334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 405/822] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:54 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:54.779849 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4dc1a984-0e5a-454e-b6fd-af341efa6238 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:54.781148 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4dc1a984-0e5a-454e-b6fd-af341efa6238 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:54.791788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4dc1a984-0e5a-454e-b6fd-af341efa6238 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:54.792257 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4dc1a984-0e5a-454e-b6fd-af341efa6238 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:54.793119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4dc1a984-0e5a-454e-b6fd-af341efa6238 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:54.793549 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4dc1a984-0e5a-454e-b6fd-af341efa6238 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:54.820670 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4dc1a984-0e5a-454e-b6fd-af341efa6238 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:55:55.145774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4dc1a984-0e5a-454e-b6fd-af341efa6238 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 204 len: 0 microversion: 2.1 time: 0.369367 Jul 20 17:55:55.146369 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 418/823] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:55:54 2022] DELETE /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:55:55.154759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-87d64bb6-e313-4bd7-986a-bd61e3b8f61b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:55.155395 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-87d64bb6-e313-4bd7-986a-bd61e3b8f61b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:55.161537 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87d64bb6-e313-4bd7-986a-bd61e3b8f61b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:55.162036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87d64bb6-e313-4bd7-986a-bd61e3b8f61b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:55.163442 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87d64bb6-e313-4bd7-986a-bd61e3b8f61b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:55.163869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-87d64bb6-e313-4bd7-986a-bd61e3b8f61b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:55.295158 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-87d64bb6-e313-4bd7-986a-bd61e3b8f61b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:55.302644 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-87d64bb6-e313-4bd7-986a-bd61e3b8f61b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1508 microversion: 2.1 time: 0.151767 Jul 20 17:55:55.303203 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 406/824] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:55 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:55.424986 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:55.425724 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:55.431671 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:55.432123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:55.432923 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:55.433363 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:55.444867 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2ff42046-fd26-44bd-8c19-e3ad9305f2e2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:55.445570 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2ff42046-fd26-44bd-8c19-e3ad9305f2e2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:55.447532 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:55.448349 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=6 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:55.453169 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2ff42046-fd26-44bd-8c19-e3ad9305f2e2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:55.453616 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2ff42046-fd26-44bd-8c19-e3ad9305f2e2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:55.454383 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2ff42046-fd26-44bd-8c19-e3ad9305f2e2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:55.454816 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2ff42046-fd26-44bd-8c19-e3ad9305f2e2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:55.633108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:55.637768 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2ff42046-fd26-44bd-8c19-e3ad9305f2e2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:55.641286 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:55.642781 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:55.644026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a0b55511-ab1e-4c3a-8924-3ce2ea3a9643 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.223367 Jul 20 17:55:55.644627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 419/825] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:55 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:55.645373 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2ff42046-fd26-44bd-8c19-e3ad9305f2e2 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.204550 Jul 20 17:55:55.650782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 407/826] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:55 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:56.319366 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e624ddf3-2285-4e5f-b411-5a5a6f70cfce tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:56.319893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e624ddf3-2285-4e5f-b411-5a5a6f70cfce tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:56.322358 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:56.327178 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e624ddf3-2285-4e5f-b411-5a5a6f70cfce tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:56.333716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e624ddf3-2285-4e5f-b411-5a5a6f70cfce tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:56.333716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e624ddf3-2285-4e5f-b411-5a5a6f70cfce tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:56.333716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e624ddf3-2285-4e5f-b411-5a5a6f70cfce tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:56.457584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e624ddf3-2285-4e5f-b411-5a5a6f70cfce tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:56.464984 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e624ddf3-2285-4e5f-b411-5a5a6f70cfce tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1508 microversion: 2.1 time: 0.149827 Jul 20 17:55:56.465548 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 420/827] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:56 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:56.662392 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ab140801-7614-41de-87b1-87c24ecaaa7f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:56.663009 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ab140801-7614-41de-87b1-87c24ecaaa7f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:56.664023 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:56.664713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:56.669562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab140801-7614-41de-87b1-87c24ecaaa7f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:56.670021 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab140801-7614-41de-87b1-87c24ecaaa7f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:56.670716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:56.670837 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab140801-7614-41de-87b1-87c24ecaaa7f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:56.671273 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ab140801-7614-41de-87b1-87c24ecaaa7f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:56.671406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:56.671987 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:56.672464 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:56.814895 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ab140801-7614-41de-87b1-87c24ecaaa7f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:56.823674 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ab140801-7614-41de-87b1-87c24ecaaa7f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.165062 Jul 20 17:55:56.833196 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 408/828] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:56 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:56.952025 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:56.959817 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:56.961339 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:56.962485 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1598a6c1-49a8-40f2-9520-e2f0e8c7cf3d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.302359 Jul 20 17:55:56.963025 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 421/829] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:56 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:55:57.481666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5560cc55-564c-4d55-baa7-7d64766a8cd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:57.482279 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5560cc55-564c-4d55-baa7-7d64766a8cd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:57.488180 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5560cc55-564c-4d55-baa7-7d64766a8cd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:57.488664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5560cc55-564c-4d55-baa7-7d64766a8cd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:57.489561 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5560cc55-564c-4d55-baa7-7d64766a8cd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:57.490014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5560cc55-564c-4d55-baa7-7d64766a8cd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:57.628509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5560cc55-564c-4d55-baa7-7d64766a8cd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:57.638209 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5560cc55-564c-4d55-baa7-7d64766a8cd1 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1508 microversion: 2.1 time: 0.160313 Jul 20 17:55:57.638793 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 409/830] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:57 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:57.841241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6c193515-46cc-4127-8a6e-75493ce995cb tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:57.841891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6c193515-46cc-4127-8a6e-75493ce995cb tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:57.848324 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c193515-46cc-4127-8a6e-75493ce995cb tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:57.848804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c193515-46cc-4127-8a6e-75493ce995cb tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:57.849575 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c193515-46cc-4127-8a6e-75493ce995cb tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:57.850712 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c193515-46cc-4127-8a6e-75493ce995cb tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:57.980720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:57.981444 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:57.988751 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:57.989342 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:57.990199 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:57.991377 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:58.062803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6c193515-46cc-4127-8a6e-75493ce995cb tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:58.070630 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6c193515-46cc-4127-8a6e-75493ce995cb tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.233327 Jul 20 17:55:58.071188 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 422/831] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:57 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:58.209048 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-746bee4c-ec8f-424f-b922-89a687b70e07 req-e003f70a-da5a-461c-95d1-1e48d28124eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9250617-ba07-4c3f-b362-f2ec35579329", "name": "network-vif-deleted", "tag": "bae138e1-ebd0-4597-bcdb-3cf21bb88799"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:55:58.218161 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-746bee4c-ec8f-424f-b922-89a687b70e07 req-e003f70a-da5a-461c-95d1-1e48d28124eb service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:58.218707 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-746bee4c-ec8f-424f-b922-89a687b70e07 req-e003f70a-da5a-461c-95d1-1e48d28124eb service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:58.228552 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:58.232578 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-746bee4c-ec8f-424f-b922-89a687b70e07 req-e003f70a-da5a-461c-95d1-1e48d28124eb service nova] Creating event network-vif-deleted:bae138e1-ebd0-4597-bcdb-3cf21bb88799 for instance c9250617-ba07-4c3f-b362-f2ec35579329 on hv-cinder-84984 Jul 20 17:55:58.236513 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-746bee4c-ec8f-424f-b922-89a687b70e07 req-e003f70a-da5a-461c-95d1-1e48d28124eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030984 Jul 20 17:55:58.237202 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:58.237855 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 423/832] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:55:58.238701 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:58.239867 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b899f3e2-9e9f-4942-bfb5-00d46c5ae66a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.263658 Jul 20 17:55:58.240570 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 410/833] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:57 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:58.654953 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1f4f6ebc-7428-4017-aa3c-e5cdf74bc789 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:58.655869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1f4f6ebc-7428-4017-aa3c-e5cdf74bc789 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:58.662127 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f4f6ebc-7428-4017-aa3c-e5cdf74bc789 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:58.662584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f4f6ebc-7428-4017-aa3c-e5cdf74bc789 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:58.663344 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f4f6ebc-7428-4017-aa3c-e5cdf74bc789 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:58.663782 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f4f6ebc-7428-4017-aa3c-e5cdf74bc789 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:58.726533 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1f4f6ebc-7428-4017-aa3c-e5cdf74bc789 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:58.734315 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1f4f6ebc-7428-4017-aa3c-e5cdf74bc789 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1293 microversion: 2.1 time: 0.083483 Jul 20 17:55:58.735001 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 424/834] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:58 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:55:59.087280 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-66e6779e-8675-4307-ad74-4d99e81d1e8b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:59.087880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-66e6779e-8675-4307-ad74-4d99e81d1e8b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:59.093875 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-66e6779e-8675-4307-ad74-4d99e81d1e8b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:59.094324 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-66e6779e-8675-4307-ad74-4d99e81d1e8b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:59.095082 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-66e6779e-8675-4307-ad74-4d99e81d1e8b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:59.095509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-66e6779e-8675-4307-ad74-4d99e81d1e8b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:59.224901 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-66e6779e-8675-4307-ad74-4d99e81d1e8b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:59.234076 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-66e6779e-8675-4307-ad74-4d99e81d1e8b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.150307 Jul 20 17:55:59.237361 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 411/835] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:59 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:55:59.258267 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:59.258907 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:59.265450 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:59.265900 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:59.266669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:59.267104 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:59.402696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:59.411021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:59.413069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:59.414288 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1819c323-c931-4afe-9c62-376b327afad0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.159893 Jul 20 17:55:59.415040 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 425/836] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:55:59 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:55:59.752618 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:55:59.753491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:55:59.760148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:59.760870 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:59.762176 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:59.762768 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:59.817303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:55:59.818081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:55:59.818755 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:55:59.864537 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:55:59.872348 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-347ddf7f-727e-46b4-ba13-6a68445392c3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1312 microversion: 2.1 time: 0.123711 Jul 20 17:55:59.872954 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 412/837] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:55:59 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:00.251196 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-776f2158-e4db-4078-adf0-d2ed3b42c019 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:00.251809 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-776f2158-e4db-4078-adf0-d2ed3b42c019 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:00.260106 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-776f2158-e4db-4078-adf0-d2ed3b42c019 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:00.260774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-776f2158-e4db-4078-adf0-d2ed3b42c019 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:00.261351 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-776f2158-e4db-4078-adf0-d2ed3b42c019 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:00.261791 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-776f2158-e4db-4078-adf0-d2ed3b42c019 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:00.429743 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-776f2158-e4db-4078-adf0-d2ed3b42c019 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:00.433090 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:00.434231 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:00.437785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-776f2158-e4db-4078-adf0-d2ed3b42c019 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.190456 Jul 20 17:56:00.441320 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 426/838] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:00 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:00.441477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:00.441796 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:00.442576 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:00.443012 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:00.590151 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:00.600289 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:00.601913 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:00.603226 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-37cfa911-dcb1-454e-b8b0-ad65ed870ccc tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.174719 Jul 20 17:56:00.603822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 413/839] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:00 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:56:00.891348 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:00.891877 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:00.898154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:00.898601 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:00.900608 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:00.901171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:00.904155 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:00.935872 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:00.936321 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:00.936794 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:00.979497 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:00.989493 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3aa2e835-95bb-46c2-b8fe-6cc7fcee6ff3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1312 microversion: 2.1 time: 0.101957 Jul 20 17:56:00.990129 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 427/840] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:00 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:01.455413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-91b4a54a-5d1c-45e6-a1e3-0d828f850be6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:01.456503 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-91b4a54a-5d1c-45e6-a1e3-0d828f850be6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:01.464317 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-91b4a54a-5d1c-45e6-a1e3-0d828f850be6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:01.464914 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-91b4a54a-5d1c-45e6-a1e3-0d828f850be6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:01.465787 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-91b4a54a-5d1c-45e6-a1e3-0d828f850be6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:01.466457 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-91b4a54a-5d1c-45e6-a1e3-0d828f850be6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:01.482692 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:01.622954 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:01.623562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:01.632351 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-91b4a54a-5d1c-45e6-a1e3-0d828f850be6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:01.638347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:01.639063 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:01.640034 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:01.640388 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-91b4a54a-5d1c-45e6-a1e3-0d828f850be6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.188771 Jul 20 17:56:01.641000 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:01.642944 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 414/841] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:01 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:01.719133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-0483d2d4-2242-4830-bc55-fe95fd4593cf req-d5495528-f23a-4953-884b-d1ffb96d87cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940b1e17-6334-434f-a6f4-ea98310e44f9", "name": "network-vif-plugged", "status": "completed", "tag": "0d2efd3e-013a-4a3b-bc60-84e6553804e3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:56:01.738720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0483d2d4-2242-4830-bc55-fe95fd4593cf req-d5495528-f23a-4953-884b-d1ffb96d87cf service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:01.741416 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0483d2d4-2242-4830-bc55-fe95fd4593cf req-d5495528-f23a-4953-884b-d1ffb96d87cf service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:01.763459 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-0483d2d4-2242-4830-bc55-fe95fd4593cf req-d5495528-f23a-4953-884b-d1ffb96d87cf service nova] Creating event network-vif-plugged:0d2efd3e-013a-4a3b-bc60-84e6553804e3 for instance 940b1e17-6334-434f-a6f4-ea98310e44f9 on hv-cinder-84984 Jul 20 17:56:01.768608 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-0483d2d4-2242-4830-bc55-fe95fd4593cf req-d5495528-f23a-4953-884b-d1ffb96d87cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054851 Jul 20 17:56:01.772942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 415/842] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:56:01.859412 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:01.866175 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:01.867852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:01.869046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ab82f192-7095-43f6-86bc-0f4e1e942adf tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.251367 Jul 20 17:56:01.869616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 428/843] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:01 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:56:02.114817 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:02.115514 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:02.122524 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:02.122976 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:02.123742 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:02.124175 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:02.157201 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:02.157652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:02.158102 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:02.203395 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:02.211615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-878efd2e-8933-4718-87e8-a65cc4238b4e tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1312 microversion: 2.1 time: 0.208405 Jul 20 17:56:02.212184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 416/844] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:02 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:02.658812 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4c7c0a06-8a17-4a1e-a74e-159e9796d5a9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:02.659696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4c7c0a06-8a17-4a1e-a74e-159e9796d5a9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:02.666652 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4c7c0a06-8a17-4a1e-a74e-159e9796d5a9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:02.667102 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4c7c0a06-8a17-4a1e-a74e-159e9796d5a9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:02.667885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4c7c0a06-8a17-4a1e-a74e-159e9796d5a9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:02.668304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4c7c0a06-8a17-4a1e-a74e-159e9796d5a9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:02.804458 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4c7c0a06-8a17-4a1e-a74e-159e9796d5a9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:02.811955 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4c7c0a06-8a17-4a1e-a74e-159e9796d5a9 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.157001 Jul 20 17:56:02.812536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 429/845] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:02 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:56:02.887148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:02.887757 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:02.894611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:02.895056 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:02.895879 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:02.896314 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:03.057883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:03.067293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:03.069179 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:03.070539 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-51095251-160b-4720-99fa-041ca030db50 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.187283 Jul 20 17:56:03.071552 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 417/846] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:02 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:03.229213 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:03.229850 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:03.235774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:03.236215 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:03.237000 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:03.237429 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:03.273492 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:03.273864 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:03.274383 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:03.316889 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:03.324577 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d3f1015c-e463-4fe8-a9aa-4e30ce361037 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1312 microversion: 2.1 time: 0.100063 Jul 20 17:56:03.325352 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 430/847] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:03 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:03.829246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d1d1b0be-c858-445a-b62e-7f5983e20bd8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:03.829860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d1d1b0be-c858-445a-b62e-7f5983e20bd8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:03.836725 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d1d1b0be-c858-445a-b62e-7f5983e20bd8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:03.837177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d1d1b0be-c858-445a-b62e-7f5983e20bd8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:03.837950 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d1d1b0be-c858-445a-b62e-7f5983e20bd8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:03.838411 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d1d1b0be-c858-445a-b62e-7f5983e20bd8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:03.980374 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d1d1b0be-c858-445a-b62e-7f5983e20bd8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:03.981872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d1d1b0be-c858-445a-b62e-7f5983e20bd8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.156491 Jul 20 17:56:03.982441 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 418/848] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:03 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:04.091312 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:04.092847 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:04.100537 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:04.100991 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:04.101764 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:04.102195 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:04.243220 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:04.251698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:04.253325 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:04.254525 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8e090992-d420-4a53-90e5-946ae7c5b913 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.169888 Jul 20 17:56:04.255069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 431/849] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:04 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:04.342263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:04.343018 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:04.350477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:04.350934 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:04.356606 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:04.356606 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:04.387551 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:04.388160 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:04.388634 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:04.437527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:04.446205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4393f808-06d3-490c-bb47-d64e492b596f tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1312 microversion: 2.1 time: 0.109063 Jul 20 17:56:04.446999 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 419/850] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:04 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:04.999467 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9fc04b6e-cc5c-48f7-a5e8-442ff417026f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:05.000082 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9fc04b6e-cc5c-48f7-a5e8-442ff417026f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:05.006197 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9fc04b6e-cc5c-48f7-a5e8-442ff417026f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:05.006680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9fc04b6e-cc5c-48f7-a5e8-442ff417026f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:05.007451 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9fc04b6e-cc5c-48f7-a5e8-442ff417026f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:05.007887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9fc04b6e-cc5c-48f7-a5e8-442ff417026f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:05.177658 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9fc04b6e-cc5c-48f7-a5e8-442ff417026f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:05.187338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9fc04b6e-cc5c-48f7-a5e8-442ff417026f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.191451 Jul 20 17:56:05.190632 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 432/851] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:04 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:05.273545 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:05.274249 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:05.281127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:05.281702 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:05.282545 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:05.283063 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:05.442370 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:05.452622 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:05.454259 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:05.455577 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0e2b4b87-7ed8-4dfc-ac73-b435840ef2ce tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.186575 Jul 20 17:56:05.456330 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 420/852] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:05 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:05.477110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:05.477804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:05.484664 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:05.485126 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:05.485909 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:05.487132 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:05.520108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:05.520766 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:05.521207 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:05.566605 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:05.575701 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-35e64652-d5a6-4d04-90c5-bf6515efc38a tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1312 microversion: 2.1 time: 0.104373 Jul 20 17:56:05.576538 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 433/853] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:05 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:06.206739 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3ebb4719-d5e5-44e2-9575-54c379f5516d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:06.207378 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3ebb4719-d5e5-44e2-9575-54c379f5516d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:06.213736 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ebb4719-d5e5-44e2-9575-54c379f5516d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:06.214189 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ebb4719-d5e5-44e2-9575-54c379f5516d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:06.214965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ebb4719-d5e5-44e2-9575-54c379f5516d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:06.215400 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ebb4719-d5e5-44e2-9575-54c379f5516d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:06.355748 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3ebb4719-d5e5-44e2-9575-54c379f5516d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:06.363664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3ebb4719-d5e5-44e2-9575-54c379f5516d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.160663 Jul 20 17:56:06.364181 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 421/854] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:06 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:06.480972 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:06.481781 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:06.488294 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:06.488785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:06.489561 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:06.490000 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:06.592230 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:06.593265 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:06.609085 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:06.609543 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:06.610331 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:06.610765 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:06.627123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:06.641735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:06.643377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:06.644726 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d77adb2e-2192-40ea-a632-f98198a0b533 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.167598 Jul 20 17:56:06.655140 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 434/855] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:06 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:06.655367 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:06.655367 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:06.655367 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:06.699469 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:06.707055 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-afb64ac8-598f-41c4-b05e-45015b4b12d3 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1312 microversion: 2.1 time: 0.118616 Jul 20 17:56:06.707823 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 422/856] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:06 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:07.379423 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a8b76410-b08c-4b36-b85c-13c320f40edf tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:07.380045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a8b76410-b08c-4b36-b85c-13c320f40edf tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:07.386857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a8b76410-b08c-4b36-b85c-13c320f40edf tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:07.388616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a8b76410-b08c-4b36-b85c-13c320f40edf tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:07.388616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a8b76410-b08c-4b36-b85c-13c320f40edf tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:07.388616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a8b76410-b08c-4b36-b85c-13c320f40edf tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:07.547776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a8b76410-b08c-4b36-b85c-13c320f40edf tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:07.556151 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a8b76410-b08c-4b36-b85c-13c320f40edf tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.180625 Jul 20 17:56:07.556750 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 435/857] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:07 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:56:07.663234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:07.663837 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:07.670376 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:07.670817 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:07.671652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:07.672075 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:07.724101 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:07.724578 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:07.731865 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:07.732292 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:07.733092 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:07.733520 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:07.765099 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:07.765540 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:07.765977 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:07.828186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:07.836813 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b1368ba0-a47b-4da6-a52f-cd1d9edde3b8 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1312 microversion: 2.1 time: 0.117455 Jul 20 17:56:07.837471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 436/858] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:07 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:56:07.847262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:07.855838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:07.857356 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:07.858815 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8840df0e-f4a7-47d3-b0be-23a74d69ecd4 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.200465 Jul 20 17:56:07.859481 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 423/859] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:07 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:08.573593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0a97e6e6-a24f-46a5-9705-1195429c90f0 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:08.574198 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0a97e6e6-a24f-46a5-9705-1195429c90f0 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:08.580625 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a97e6e6-a24f-46a5-9705-1195429c90f0 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:08.581069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a97e6e6-a24f-46a5-9705-1195429c90f0 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:08.581814 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a97e6e6-a24f-46a5-9705-1195429c90f0 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:08.582241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0a97e6e6-a24f-46a5-9705-1195429c90f0 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:08.715881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0a97e6e6-a24f-46a5-9705-1195429c90f0 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:08.723142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0a97e6e6-a24f-46a5-9705-1195429c90f0 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.154038 Jul 20 17:56:08.725779 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 437/860] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:08 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:08.853805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:08.854386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:08.860942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:08.861386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:08.862142 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:08.862570 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:08.876212 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:08.876887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:08.883409 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:08.883858 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:08.884650 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:08.885083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:08.895694 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:08.896137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:08.896607 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid c9250617-ba07-4c3f-b362-f2ec35579329 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:08.959129 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:08.966552 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8474956a-588a-41ac-841c-f36fb3ae52ba tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 200 len: 1312 microversion: 2.1 time: 0.116700 Jul 20 17:56:08.967129 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 424/861] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:08 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:09.062179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:09.070475 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:09.071978 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:09.073198 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4827f4ee-9961-4c02-9f42-51b97008f80a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.200898 Jul 20 17:56:09.073753 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 438/862] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:08 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:56:09.740072 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3b8d3682-bef0-46e2-a0c5-160fe8899f5b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:09.741341 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3b8d3682-bef0-46e2-a0c5-160fe8899f5b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:09.747448 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3b8d3682-bef0-46e2-a0c5-160fe8899f5b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:09.747913 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3b8d3682-bef0-46e2-a0c5-160fe8899f5b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:09.748724 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3b8d3682-bef0-46e2-a0c5-160fe8899f5b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:09.749174 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3b8d3682-bef0-46e2-a0c5-160fe8899f5b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:09.895785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3b8d3682-bef0-46e2-a0c5-160fe8899f5b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:09.904135 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3b8d3682-bef0-46e2-a0c5-160fe8899f5b tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1259 microversion: 2.1 time: 0.167973 Jul 20 17:56:09.904861 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 425/863] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:09 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:09.983047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:09.983586 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: c9250617-ba07-4c3f-b362-f2ec35579329] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:09.990021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:09.990472 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:09.991820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:09.992260 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.005200 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] HTTP exception thrown: Instance c9250617-ba07-4c3f-b362-f2ec35579329 could not be found. Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Request method failure captured: Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 HTTP/1.1 Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2ECFR8Chf_-oC5r4ltXJ63KUnxvQuEmcxamgLZkPzUQBaz6u_DRxVxJh81w11ssb1D_5EnfdMiUucEa-pyrvFRYV06pWwIIiHHbWBmycepP5B806CKpRGnYDA__HD_ppgbQ3YrlOygxDiDxAFTS3iVoixCYUCzSkehzwaC58aAjvgvc Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:56:10.006856 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bde6b55e64864d188ee5fafc4b9edc4a"}]}] Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 8daac4acc2fb4d47a7549ef710a70fca Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance c9250617-ba07-4c3f-b362-f2ec35579329 could not be found. Jul 20 17:56:10.008499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'c9250617-ba07-4c3f-b362-f2ec35579329'} Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9250617-ba07-4c3f-b362-f2ec35579329 could not be found. Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:10.009590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9250617-ba07-4c3f-b362-f2ec35579329 could not be found. Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9250617-ba07-4c3f-b362-f2ec35579329 could not be found. Jul 20 17:56:10.011199 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:10.012822 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Returning 404 to user: Instance c9250617-ba07-4c3f-b362-f2ec35579329 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:10.012822 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-820c95e1-d04b-4814-af86-639074830d65 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329" status: 404 len: 111 microversion: 2.1 time: 0.029148 Jul 20 17:56:10.012822 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 439/864] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:09 2022] GET /compute/v2.1/servers/c9250617-ba07-4c3f-b362-f2ec35579329 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:56:10.016711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e9e1ca1f-fe0c-44f6-9b23-d6d249dff114 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:10.017218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e9e1ca1f-fe0c-44f6-9b23-d6d249dff114 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:10.023238 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e1ca1f-fe0c-44f6-9b23-d6d249dff114 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.023688 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e1ca1f-fe0c-44f6-9b23-d6d249dff114 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.024478 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e1ca1f-fe0c-44f6-9b23-d6d249dff114 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.024921 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e9e1ca1f-fe0c-44f6-9b23-d6d249dff114 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.050047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e9e1ca1f-fe0c-44f6-9b23-d6d249dff114 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:56:10.091622 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:10.098104 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:10.098499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.098958 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.099738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.101719 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.234865 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:10.242898 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:10.244392 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:10.245573 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-721a3eda-7ef4-4e45-8422-302c98a73a00 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.157977 Jul 20 17:56:10.246122 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 440/865] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:10 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:56:10.358720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e9e1ca1f-fe0c-44f6-9b23-d6d249dff114 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 204 len: 0 microversion: 2.1 time: 0.345623 Jul 20 17:56:10.359314 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 426/866] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:56:10 2022] DELETE /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 17:56:10.367746 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6a853131-7c1a-4b45-9528-941d6bc133ca tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:10.368371 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6a853131-7c1a-4b45-9528-941d6bc133ca tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:10.374322 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6a853131-7c1a-4b45-9528-941d6bc133ca tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.374764 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6a853131-7c1a-4b45-9528-941d6bc133ca tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.375512 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6a853131-7c1a-4b45-9528-941d6bc133ca tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.375942 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6a853131-7c1a-4b45-9528-941d6bc133ca tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.504411 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6a853131-7c1a-4b45-9528-941d6bc133ca tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:10.512347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6a853131-7c1a-4b45-9528-941d6bc133ca tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.148745 Jul 20 17:56:10.513498 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 441/867] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:10 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:10.921867 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-785460b7-092f-4116-ae98-41f515578b63 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:10.922556 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-785460b7-092f-4116-ae98-41f515578b63 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:10.929450 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-785460b7-092f-4116-ae98-41f515578b63 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.929887 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-785460b7-092f-4116-ae98-41f515578b63 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.930642 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-785460b7-092f-4116-ae98-41f515578b63 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.931078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-785460b7-092f-4116-ae98-41f515578b63 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.976372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4ddbe2ca-43b4-4261-8a18-0941a7542216 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:10.976911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4ddbe2ca-43b4-4261-8a18-0941a7542216 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:10.982745 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4ddbe2ca-43b4-4261-8a18-0941a7542216 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.983186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4ddbe2ca-43b4-4261-8a18-0941a7542216 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:10.983937 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4ddbe2ca-43b4-4261-8a18-0941a7542216 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:10.984362 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4ddbe2ca-43b4-4261-8a18-0941a7542216 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:11.008469 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4ddbe2ca-43b4-4261-8a18-0941a7542216 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/ips" status: 200 len: 149 microversion: 2.1 time: 0.035853 Jul 20 17:56:11.009014 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 442/868] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 17:56:10 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:56:11.065731 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-785460b7-092f-4116-ae98-41f515578b63 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:11.074183 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-785460b7-092f-4116-ae98-41f515578b63 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1443 microversion: 2.1 time: 0.156564 Jul 20 17:56:11.074748 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 427/869] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:10 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:11.089892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3299d0d2-5b8d-4de0-b495-1b29741c16b4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:11.090507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3299d0d2-5b8d-4de0-b495-1b29741c16b4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:11.096570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3299d0d2-5b8d-4de0-b495-1b29741c16b4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:11.097018 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3299d0d2-5b8d-4de0-b495-1b29741c16b4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:11.097781 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3299d0d2-5b8d-4de0-b495-1b29741c16b4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:11.098201 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3299d0d2-5b8d-4de0-b495-1b29741c16b4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:11.117128 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=100 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:11.263912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:11.264575 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:11.271258 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:11.275783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:11.275783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:11.275783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:11.547068 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3299d0d2-5b8d-4de0-b495-1b29741c16b4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:11.551949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:11.555492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:11.555679 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3299d0d2-5b8d-4de0-b495-1b29741c16b4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1443 microversion: 2.1 time: 0.469467 Jul 20 17:56:11.556570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 443/870] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:11 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1443 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:11.573275 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4f194535-6b85-4019-8215-3b984088639d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:11.573951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4f194535-6b85-4019-8215-3b984088639d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:11.581434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4f194535-6b85-4019-8215-3b984088639d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:11.582988 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4f194535-6b85-4019-8215-3b984088639d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:11.582988 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4f194535-6b85-4019-8215-3b984088639d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:11.583577 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4f194535-6b85-4019-8215-3b984088639d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:11.593672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:11.595621 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:11.597343 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-61d25438-49aa-46bd-9420-c096e419e614 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.337317 Jul 20 17:56:11.597966 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 428/871] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:11 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:11.607622 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-8f3f3d56-dae9-4a64-9d1b-5c1fe2538bf6 req-855cf754-23c4-41fb-a426-dc7ce7fe2d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e70e71-0f97-4e13-8c1b-88944978cb60", "name": "network-vif-plugged", "status": "completed", "tag": "c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:56:11.617430 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8f3f3d56-dae9-4a64-9d1b-5c1fe2538bf6 req-855cf754-23c4-41fb-a426-dc7ce7fe2d38 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:11.617873 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-8f3f3d56-dae9-4a64-9d1b-5c1fe2538bf6 req-855cf754-23c4-41fb-a426-dc7ce7fe2d38 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:11.633413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-8f3f3d56-dae9-4a64-9d1b-5c1fe2538bf6 req-855cf754-23c4-41fb-a426-dc7ce7fe2d38 service nova] Creating event network-vif-plugged:c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9 for instance 08e70e71-0f97-4e13-8c1b-88944978cb60 on hv-cinder-84984 Jul 20 17:56:11.638911 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-8f3f3d56-dae9-4a64-9d1b-5c1fe2538bf6 req-855cf754-23c4-41fb-a426-dc7ce7fe2d38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039444 Jul 20 17:56:11.639860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 429/872] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:56:11.756687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4f194535-6b85-4019-8215-3b984088639d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:11.764228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4f194535-6b85-4019-8215-3b984088639d tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.194736 Jul 20 17:56:11.764823 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 444/873] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:11 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:12.618744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:12.620114 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:12.627814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:12.628277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:12.629356 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:12.629794 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:12.656898 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7ffba45f-21df-4ed1-9789-5428e1c86a55 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca90d093-b454-47d1-a810-c4a4b26ad7fb"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:56:12.658028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7ffba45f-21df-4ed1-9789-5428e1c86a55 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:12.664501 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ffba45f-21df-4ed1-9789-5428e1c86a55 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:12.664951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ffba45f-21df-4ed1-9789-5428e1c86a55 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:12.665714 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ffba45f-21df-4ed1-9789-5428e1c86a55 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:12.666141 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7ffba45f-21df-4ed1-9789-5428e1c86a55 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:12.779121 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:12.788061 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:12.789594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:12.790758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2774c7b2-2b96-44e5-aa9d-ab6d6e7e4c68 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.177486 Jul 20 17:56:12.791316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 430/874] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:12 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:12.795653 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-02ca09ce-9696-4f84-ba21-efd111239800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:12.796247 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-02ca09ce-9696-4f84-ba21-efd111239800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:12.802200 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02ca09ce-9696-4f84-ba21-efd111239800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:12.802758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02ca09ce-9696-4f84-ba21-efd111239800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:12.804057 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02ca09ce-9696-4f84-ba21-efd111239800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:12.804517 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-02ca09ce-9696-4f84-ba21-efd111239800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:12.984409 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-02ca09ce-9696-4f84-ba21-efd111239800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:12.984409 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-02ca09ce-9696-4f84-ba21-efd111239800 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.154396 Jul 20 17:56:12.984409 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 431/875] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:12 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:13.810874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:13.811689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:13.821287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:13.821936 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:13.822737 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:13.823179 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:13.967446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:13.975942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:13.977470 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:13.978619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-10d4fa2f-c871-4dfa-9d72-240079119616 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.172682 Jul 20 17:56:13.979184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 432/876] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:13 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 17:56:13.990669 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a6644dd3-2341-4164-a5bb-ddd29dc0d7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:13.991276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a6644dd3-2341-4164-a5bb-ddd29dc0d7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:13.993183 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:13.998893 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6644dd3-2341-4164-a5bb-ddd29dc0d7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:13.999337 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6644dd3-2341-4164-a5bb-ddd29dc0d7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:14.005390 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6644dd3-2341-4164-a5bb-ddd29dc0d7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:14.005390 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6644dd3-2341-4164-a5bb-ddd29dc0d7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:14.141649 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a6644dd3-2341-4164-a5bb-ddd29dc0d7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:14.150440 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a6644dd3-2341-4164-a5bb-ddd29dc0d7c7 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1521 microversion: 2.1 time: 0.163374 Jul 20 17:56:14.151136 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 433/877] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:13 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:56:14.726436 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-3d7da28d-9e86-4370-a918-b3e6d8d02eed req-39de9fd3-42ed-4fe8-9ada-9eeaf0b735d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940b1e17-6334-434f-a6f4-ea98310e44f9", "tag": "0d2efd3e-013a-4a3b-bc60-84e6553804e3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:56:14.737466 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-3d7da28d-9e86-4370-a918-b3e6d8d02eed req-39de9fd3-42ed-4fe8-9ada-9eeaf0b735d3 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:14.738154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-3d7da28d-9e86-4370-a918-b3e6d8d02eed req-39de9fd3-42ed-4fe8-9ada-9eeaf0b735d3 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:14.752044 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-3d7da28d-9e86-4370-a918-b3e6d8d02eed req-39de9fd3-42ed-4fe8-9ada-9eeaf0b735d3 service nova] Creating event network-changed:0d2efd3e-013a-4a3b-bc60-84e6553804e3 for instance 940b1e17-6334-434f-a6f4-ea98310e44f9 on hv-cinder-84984 Jul 20 17:56:14.757690 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-3d7da28d-9e86-4370-a918-b3e6d8d02eed req-39de9fd3-42ed-4fe8-9ada-9eeaf0b735d3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035452 Jul 20 17:56:14.759978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 434/878] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:56:14.765717 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-65b1eff6-44ec-413e-b311-5d6a50ced901 req-48452bbb-a6e4-4693-8e8e-6a21efa10283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae", "name": "network-vif-deleted", "tag": "834d8ae3-1bcc-46f1-94a8-0bd4c43bc18c"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:56:14.774264 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-65b1eff6-44ec-413e-b311-5d6a50ced901 req-48452bbb-a6e4-4693-8e8e-6a21efa10283 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:14.774713 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-65b1eff6-44ec-413e-b311-5d6a50ced901 req-48452bbb-a6e4-4693-8e8e-6a21efa10283 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:14.786343 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-65b1eff6-44ec-413e-b311-5d6a50ced901 req-48452bbb-a6e4-4693-8e8e-6a21efa10283 service nova] Creating event network-vif-deleted:834d8ae3-1bcc-46f1-94a8-0bd4c43bc18c for instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae on hv-cinder-84984 Jul 20 17:56:14.791244 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-65b1eff6-44ec-413e-b311-5d6a50ced901 req-48452bbb-a6e4-4693-8e8e-6a21efa10283 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029657 Jul 20 17:56:14.791868 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 435/879] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:56:14.796354 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7ffba45f-21df-4ed1-9789-5428e1c86a55 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "POST /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.140620 Jul 20 17:56:14.796354 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 445/880] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:56:12 2022] POST /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments => generated 194 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:56:14.998345 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:14.998942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:15.005218 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:15.005684 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:15.006468 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:15.006907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:15.156326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:15.164413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:15.165943 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:15.167118 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9b63de60-f376-4420-a8e8-16f4f0f6468f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.173611 Jul 20 17:56:15.167674 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 436/881] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:14 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:15.168795 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7fb44ac9-7a43-4f43-bc5c-d8a839293803 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:15.169785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7fb44ac9-7a43-4f43-bc5c-d8a839293803 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:15.176808 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fb44ac9-7a43-4f43-bc5c-d8a839293803 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:15.177613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fb44ac9-7a43-4f43-bc5c-d8a839293803 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:15.178766 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fb44ac9-7a43-4f43-bc5c-d8a839293803 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:15.179297 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7fb44ac9-7a43-4f43-bc5c-d8a839293803 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:15.266786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7fb44ac9-7a43-4f43-bc5c-d8a839293803 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:15.276125 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7fb44ac9-7a43-4f43-bc5c-d8a839293803 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1307 microversion: 2.1 time: 0.112087 Jul 20 17:56:15.276905 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 446/882] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:15 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:16.185391 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:16.186174 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:16.193113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:16.193640 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:16.200769 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:16.200769 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:16.292794 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:16.293340 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:16.299757 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:16.300210 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:16.301014 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:16.301451 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:16.336012 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:16.336834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:16.337289 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:16.337911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lazy-loading 'fault' on Instance uuid 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:16.345305 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:16.351007 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:16.351007 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bd8570be-e592-4593-bc3b-553a84d9e8ef tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1728 microversion: 2.20 time: 0.166996 Jul 20 17:56:16.351007 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 437/883] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:16 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:16.382568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8daac4acc2fb4d47a7549ef710a70fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde6b55e64864d188ee5fafc4b9edc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:16.390208 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ac389b65-7445-4a13-94e1-9cfcb9b3e91b tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 200 len: 1312 microversion: 2.1 time: 0.101370 Jul 20 17:56:16.390769 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 447/884] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:16 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:56:17.365893 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:17.366511 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:17.372995 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:17.373451 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:17.374217 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:17.374658 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:17.406894 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:17.407510 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] [instance: 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:17.414331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:17.414778 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:17.415533 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:17.415965 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:17.429268 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] HTTP exception thrown: Instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae could not be found. Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Request method failure captured: Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae HTTP/1.1 Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2ECFR8Chf_-oC5r4ltXJ63KUnxvQuEmcxamgLZkPzUQBaz6u_DRxVxJh81w11ssb1D_5EnfdMiUucEa-pyrvFRYV06pWwIIiHHbWBmycepP5B806CKpRGnYDA__HD_ppgbQ3YrlOygxDiDxAFTS3iVoixCYUCzSkehzwaC58aAjvgvc Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:56:17.430933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bde6b55e64864d188ee5fafc4b9edc4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bde6b55e64864d188ee5fafc4b9edc4a"}]}] Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: bde6b55e64864d188ee5fafc4b9edc4a Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1242666841 Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 8daac4acc2fb4d47a7549ef710a70fca Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1242666841-project Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae could not be found. Jul 20 17:56:17.432629 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae'} Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae could not be found. Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:17.433491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae could not be found. Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae could not be found. Jul 20 17:56:17.434913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:17.436071 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] Returning 404 to user: Instance 9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:17.436071 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e56615aa-151b-4c72-bab3-2ff8b334dc93 tempest-ServerRescueNegativeTestJSON-1242666841 tempest-ServerRescueNegativeTestJSON-1242666841-project] 10.222.0.42 "GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae" status: 404 len: 111 microversion: 2.1 time: 0.029227 Jul 20 17:56:17.436071 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 448/885] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:17 2022] GET /compute/v2.1/servers/9d3b5046-fb6f-4c5f-a2a1-be8074b1a1ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 17:56:17.510727 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:17.518758 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:17.520292 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:17.521452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-5e483c59-9c8a-4c1a-97a1-ef80a85ed77d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1715 microversion: 2.20 time: 0.159515 Jul 20 17:56:17.522633 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 438/886] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:17 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:22.624803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5b39a36a-aba2-4568-a30c-5ff0ddc5bcc3 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] Action: 'create', calling method: .version_select at 0x7f7d3d741940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-413668626", "metadata": {"Type": "work"}}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:56:23.351997 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5b39a36a-aba2-4568-a30c-5ff0ddc5bcc3 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.839951 Jul 20 17:56:23.352655 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 449/887] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jul 20 17:56:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 841 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 17:56:23.363554 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cdc87b09-11ca-4efe-8836-4991e6c13536 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] Calling method '.version_select at 0x7f7d3deb7f70>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:23.413078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cdc87b09-11ca-4efe-8836-4991e6c13536 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c" status: 200 len: 352 microversion: 2.1 time: 0.052424 Jul 20 17:56:23.413647 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 439/888] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:56:23 2022] GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:56:23.479893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6d580c46-3061-4454-8497-9477f830724e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:23.482291 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6d580c46-3061-4454-8497-9477f830724e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:23.482602 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:23.488287 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6d580c46-3061-4454-8497-9477f830724e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:23.488762 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6d580c46-3061-4454-8497-9477f830724e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:23.489515 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6d580c46-3061-4454-8497-9477f830724e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:23.489951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6d580c46-3061-4454-8497-9477f830724e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:23.572041 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-6d580c46-3061-4454-8497-9477f830724e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lazy-loading 'services' on Instance uuid cb58a28d-f081-4f5b-8f8e-81883503f50b {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:23.815657 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6d580c46-3061-4454-8497-9477f830724e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments/ca90d093-b454-47d1-a810-c4a4b26ad7fb" status: 202 len: 0 microversion: 2.1 time: 0.339260 Jul 20 17:56:23.816636 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 450/889] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:56:23 2022] DELETE /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments/ca90d093-b454-47d1-a810-c4a4b26ad7fb => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 17:56:23.825058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c1da37ef-d762-4199-9a2b-a3ebc9ef39bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:23.826300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c1da37ef-d762-4199-9a2b-a3ebc9ef39bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:23.832470 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1da37ef-d762-4199-9a2b-a3ebc9ef39bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:23.832929 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1da37ef-d762-4199-9a2b-a3ebc9ef39bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:23.836893 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1da37ef-d762-4199-9a2b-a3ebc9ef39bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:23.836893 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c1da37ef-d762-4199-9a2b-a3ebc9ef39bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:23.864956 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c1da37ef-d762-4199-9a2b-a3ebc9ef39bd tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043832 Jul 20 17:56:23.865523 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 440/890] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:56:23 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:56:24.429536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7153eee8-0fe6-472c-9d50-f99982764ef6 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] Calling method '.version_select at 0x7f7d3d69f8b0>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:24.480666 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7153eee8-0fe6-472c-9d50-f99982764ef6 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c" status: 200 len: 353 microversion: 2.1 time: 0.051441 Jul 20 17:56:24.480666 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 451/891] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:56:24 2022] GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:56:24.490102 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-67c4c6a9-f313-497a-8f97-308d2e7c1827 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] Calling method '.version_select at 0x7f7d3d608f70>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:24.537349 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-67c4c6a9-f313-497a-8f97-308d2e7c1827 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c" status: 200 len: 353 microversion: 2.1 time: 0.050992 Jul 20 17:56:24.537924 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 441/892] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:56:24 2022] GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:56:24.554815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-44a04634-95d6-4a73-9a1c-127991dd60df tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] Calling method '.version_select at 0x7f7d3d80c280>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:24.866197 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-44a04634-95d6-4a73-9a1c-127991dd60df tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c" status: 202 len: 0 microversion: 2.1 time: 0.315440 Jul 20 17:56:24.866940 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 452/893] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 17:56:24 2022] DELETE /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:56:24.875313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b9ff425b-f6ac-4724-8875-355c699e6515 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] Calling method '.version_select at 0x7f7d3deb7a60>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:24.876724 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4e05a7df-8cab-4c0c-b711-07672e517b0f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:24.878023 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4e05a7df-8cab-4c0c-b711-07672e517b0f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:24.890725 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4e05a7df-8cab-4c0c-b711-07672e517b0f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:24.891179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4e05a7df-8cab-4c0c-b711-07672e517b0f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:24.891950 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4e05a7df-8cab-4c0c-b711-07672e517b0f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:24.892387 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4e05a7df-8cab-4c0c-b711-07672e517b0f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:24.924058 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4e05a7df-8cab-4c0c-b711-07672e517b0f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051314 Jul 20 17:56:24.926894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b9ff425b-f6ac-4724-8875-355c699e6515 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c" status: 200 len: 352 microversion: 2.1 time: 0.055650 Jul 20 17:56:24.927657 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 442/894] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:56:24 2022] GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:56:24.928793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 453/895] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:56:24 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 17:56:25.939749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cda6b8ea-ed46-4382-8c56-198f495c8785 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:25.940696 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cda6b8ea-ed46-4382-8c56-198f495c8785 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:25.942908 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4e7fdf35-71eb-4e69-ae23-c02d62ae6009 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] Calling method '.version_select at 0x7f7d3d741040>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:25.947533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cda6b8ea-ed46-4382-8c56-198f495c8785 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:25.947985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cda6b8ea-ed46-4382-8c56-198f495c8785 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:25.948783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cda6b8ea-ed46-4382-8c56-198f495c8785 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:25.949232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-cda6b8ea-ed46-4382-8c56-198f495c8785 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:25.971522 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-4e7fdf35-71eb-4e69-ae23-c02d62ae6009 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] HTTP exception thrown: Volume 0179c6a6-d594-491e-9f51-a3ea5ed7033c could not be found. Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4e7fdf35-71eb-4e69-ae23-c02d62ae6009 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] Request method failure captured: Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c HTTP/1.1 Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EHGqhmC9_azaNo-NLiNh0HoE8KaV8b9VHT6MYQocN5WzwFnCyyBMDM7gd4zvMcpetp797OOEnQ_pZNrPQQ7K99bwcPiwAFPi9nnD_u1lTAqaJzmAVxXO01ZzguW6JDR6BGTL_gPt5JNXBTHFQZpPnPFVehouyQljHYzkRlETm0LFGQ Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 7e21654a69004b4dbeca5366892ddcb5 Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-VolumesGetTestJSON-1111519563 Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:56:25.973682 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e21654a69004b4dbeca5366892ddcb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e21654a69004b4dbeca5366892ddcb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e21654a69004b4dbeca5366892ddcb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e21654a69004b4dbeca5366892ddcb5"}]}] Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-VolumesGetTestJSON-1111519563 Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 7e21654a69004b4dbeca5366892ddcb5 Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-VolumesGetTestJSON-1111519563 Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-VolumesGetTestJSON-1111519563-project Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 5fee1f51d2d445239b7aa2211d700e6a Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-VolumesGetTestJSON-1111519563-project Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Volume 0179c6a6-d594-491e-9f51-a3ea5ed7033c could not be found. Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '0179c6a6-d594-491e-9f51-a3ea5ed7033c'} Jul 20 17:56:25.975938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0179c6a6-d594-491e-9f51-a3ea5ed7033c could not be found. (HTTP 404) (Request-ID: req-287e785c-9e97-44bc-bb12-e7dca11ed87e) Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:25.976887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 17:56:25.978038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0179c6a6-d594-491e-9f51-a3ea5ed7033c could not be found. Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 17:56:25.979967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0179c6a6-d594-491e-9f51-a3ea5ed7033c could not be found. Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0179c6a6-d594-491e-9f51-a3ea5ed7033c could not be found. Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4e7fdf35-71eb-4e69-ae23-c02d62ae6009 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] Returning 404 to user: Volume 0179c6a6-d594-491e-9f51-a3ea5ed7033c could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4e7fdf35-71eb-4e69-ae23-c02d62ae6009 tempest-VolumesGetTestJSON-1111519563 tempest-VolumesGetTestJSON-1111519563-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c" status: 404 len: 109 microversion: 2.1 time: 0.036224 Jul 20 17:56:25.982282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 454/896] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jul 20 17:56:25 2022] GET /compute/v2.1/os-volumes/0179c6a6-d594-491e-9f51-a3ea5ed7033c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 17:56:25.983935 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cda6b8ea-ed46-4382-8c56-198f495c8785 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048613 Jul 20 17:56:25.988880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 443/897] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 17:56:25 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 17:56:26.042428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9ef1ba48-a983-44d6-b1ec-1cb1cb750eca tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:26.051610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9ef1ba48-a983-44d6-b1ec-1cb1cb750eca tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:26.051610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ef1ba48-a983-44d6-b1ec-1cb1cb750eca tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:26.051610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ef1ba48-a983-44d6-b1ec-1cb1cb750eca tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:26.051610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ef1ba48-a983-44d6-b1ec-1cb1cb750eca tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:26.052120 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9ef1ba48-a983-44d6-b1ec-1cb1cb750eca tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:26.076289 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9ef1ba48-a983-44d6-b1ec-1cb1cb750eca tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:56:26.431202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9ef1ba48-a983-44d6-b1ec-1cb1cb750eca tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 204 len: 0 microversion: 2.1 time: 0.392302 Jul 20 17:56:26.431790 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 455/898] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:56:26 2022] DELETE /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:56:26.439795 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2c86d667-295e-4605-a3ae-fbbedc62a57f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:26.440408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2c86d667-295e-4605-a3ae-fbbedc62a57f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:26.446980 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c86d667-295e-4605-a3ae-fbbedc62a57f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:26.447427 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c86d667-295e-4605-a3ae-fbbedc62a57f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:26.448197 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c86d667-295e-4605-a3ae-fbbedc62a57f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:26.448769 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2c86d667-295e-4605-a3ae-fbbedc62a57f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:26.581979 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2c86d667-295e-4605-a3ae-fbbedc62a57f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:26.591176 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2c86d667-295e-4605-a3ae-fbbedc62a57f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1680 microversion: 2.1 time: 0.154714 Jul 20 17:56:26.592424 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 444/899] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:26 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:27.610072 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e6736197-f920-46a7-a30f-20b460bff41c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:27.610696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e6736197-f920-46a7-a30f-20b460bff41c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:27.617783 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e6736197-f920-46a7-a30f-20b460bff41c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:27.623052 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e6736197-f920-46a7-a30f-20b460bff41c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:27.623052 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e6736197-f920-46a7-a30f-20b460bff41c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:27.623052 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e6736197-f920-46a7-a30f-20b460bff41c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:27.775502 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e6736197-f920-46a7-a30f-20b460bff41c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:27.783285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e6736197-f920-46a7-a30f-20b460bff41c tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1680 microversion: 2.1 time: 0.177623 Jul 20 17:56:27.784171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 456/900] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:27 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:28.801443 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-761446c8-cb82-43a2-b859-95b9aad25bff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:28.802175 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-761446c8-cb82-43a2-b859-95b9aad25bff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:28.809183 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-761446c8-cb82-43a2-b859-95b9aad25bff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:28.809837 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-761446c8-cb82-43a2-b859-95b9aad25bff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:28.810762 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-761446c8-cb82-43a2-b859-95b9aad25bff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:28.811364 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-761446c8-cb82-43a2-b859-95b9aad25bff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:28.994065 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-761446c8-cb82-43a2-b859-95b9aad25bff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:29.003469 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-761446c8-cb82-43a2-b859-95b9aad25bff tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1680 microversion: 2.1 time: 0.206239 Jul 20 17:56:29.004743 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 445/901] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:28 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:29.297181 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-9116dde9-d0cc-45c7-ba47-395c3add26ed req-ea5c607e-e82d-4e15-a451-bf33e38ab8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb58a28d-f081-4f5b-8f8e-81883503f50b", "name": "network-vif-deleted", "tag": "5c8e7455-3527-48af-b2d4-c650e2760d71"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:56:29.307585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-9116dde9-d0cc-45c7-ba47-395c3add26ed req-ea5c607e-e82d-4e15-a451-bf33e38ab8d1 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:29.308252 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-9116dde9-d0cc-45c7-ba47-395c3add26ed req-ea5c607e-e82d-4e15-a451-bf33e38ab8d1 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:29.326335 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-9116dde9-d0cc-45c7-ba47-395c3add26ed req-ea5c607e-e82d-4e15-a451-bf33e38ab8d1 service nova] Creating event network-vif-deleted:5c8e7455-3527-48af-b2d4-c650e2760d71 for instance cb58a28d-f081-4f5b-8f8e-81883503f50b on hv-cinder-84984 Jul 20 17:56:29.332520 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-9116dde9-d0cc-45c7-ba47-395c3add26ed req-ea5c607e-e82d-4e15-a451-bf33e38ab8d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038893 Jul 20 17:56:29.335295 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 457/902] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:56:30.023248 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:30.024735 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:30.033472 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:30.034205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:30.035281 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:30.035857 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:30.074156 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:30.074683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:30.075406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lazy-loading 'fault' on Instance uuid cb58a28d-f081-4f5b-8f8e-81883503f50b {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:30.120709 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077a7934f9c4407a70a8790b8da9cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93918dc6b6f445d18a3ecb003524152d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:30.129246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-141d323b-cbc0-4bd0-8c44-f0a610b3dc33 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 200 len: 1331 microversion: 2.1 time: 0.111738 Jul 20 17:56:30.129827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 446/903] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:30 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:31.147598 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:31.148364 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:31.155053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:31.155495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:31.156249 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:31.156711 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:31.170829 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b HTTP/1.1 Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:56:31.172524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:31.174047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'cb58a28d-f081-4f5b-8f8e-81883503f50b'} Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:31.178304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:31.179867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:31.181247 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:31.181247 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-73c43249-b0c2-4f14-be61-88bbab24f1e2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 404 len: 111 microversion: 2.1 time: 0.031029 Jul 20 17:56:31.181247 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 458/904] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:31 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:56:31.182736 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d29289b1-056f-4d9c-a9b6-009784475e6f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '.version_select at 0x7f7d3deb70d0>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:31.291402 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d29289b1-056f-4d9c-a9b6-009784475e6f tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049868976" status: 202 len: 0 microversion: 2.1 time: 0.112311 Jul 20 17:56:31.291970 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 447/905] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jul 20 17:56:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049868976 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:56:33.527678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:33.532189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:33.534672 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:33.535121 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:33.535879 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:33.536313 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:33.549975 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b HTTP/1.1 Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:56:33.551503 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.558902 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'cb58a28d-f081-4f5b-8f8e-81883503f50b'} Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:33.559935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.561453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.562996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:33.562996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c5e28f65-4c38-4fcf-9f33-d513d5f0552e tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 404 len: 111 microversion: 2.1 time: 0.029217 Jul 20 17:56:33.562996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 459/906] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:56:33 2022] DELETE /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:56:33.563255 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:33.563255 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: cb58a28d-f081-4f5b-8f8e-81883503f50b] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:33.569682 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:33.570136 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:33.570907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:33.571345 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:33.584820 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b HTTP/1.1 Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:56:33.586446 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.587967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'cb58a28d-f081-4f5b-8f8e-81883503f50b'} Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:33.591891 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. Jul 20 17:56:33.593362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:33.594785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance cb58a28d-f081-4f5b-8f8e-81883503f50b could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:33.594785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-1d723dea-963a-47a7-bb29-11a0c0391fdc tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b" status: 404 len: 111 microversion: 2.1 time: 0.030452 Jul 20 17:56:33.594785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 448/907] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:33 2022] GET /compute/v2.1/servers/cb58a28d-f081-4f5b-8f8e-81883503f50b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 17:56:34.883616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:34.884183 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:34.890607 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:34.891120 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:34.891959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:34.892502 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:34.906351 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc HTTP/1.1 Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:56:34.907880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.909478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '2eb538a5-8c91-4cb8-8365-8902212955dc'} Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:34.910233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.911417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.913225 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:34.913225 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-acf32c9c-2263-4a05-8151-07f551f104d2 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 404 len: 111 microversion: 2.1 time: 0.029554 Jul 20 17:56:34.913225 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 460/908] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:56:34 2022] DELETE /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:56:34.918180 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:34.918788 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: 2eb538a5-8c91-4cb8-8365-8902212955dc] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:34.925198 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:34.925647 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:34.926402 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:34.926834 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:34.939870 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc HTTP/1.1 Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:56:34.941397 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.943253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '2eb538a5-8c91-4cb8-8365-8902212955dc'} Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:34.944062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. Jul 20 17:56:34.945399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.946508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance 2eb538a5-8c91-4cb8-8365-8902212955dc could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:34.946508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2ab5450b-4ffc-46fe-b72a-48104ed8b829 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc" status: 404 len: 111 microversion: 2.1 time: 0.028648 Jul 20 17:56:34.946508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 449/909] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:34 2022] GET /compute/v2.1/servers/2eb538a5-8c91-4cb8-8365-8902212955dc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:56:34.952219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:34.952741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:34.959406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:34.959841 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:34.960656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:34.961272 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:34.974595 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 HTTP/1.1 Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:56:34.976236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:34.977831 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'a959b594-9ce2-4fb1-b648-4016dfecb1b1'} Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:34.978717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:34.980211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:34.982372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:34.982372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5ee2a582-dce9-4dab-a891-9bd913cce15d tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 404 len: 111 microversion: 2.1 time: 0.030310 Jul 20 17:56:34.982372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 461/910] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:56:34 2022] DELETE /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:56:34.987973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:34.988765 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: a959b594-9ce2-4fb1-b648-4016dfecb1b1] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:34.996311 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:34.996683 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:34.997574 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:34.997989 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:35.011735 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 HTTP/1.1 Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:56:35.013300 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:35.014894 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'a959b594-9ce2-4fb1-b648-4016dfecb1b1'} Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:35.015710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. Jul 20 17:56:35.016985 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:35.018064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance a959b594-9ce2-4fb1-b648-4016dfecb1b1 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:35.018064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-23aaf1ca-b04d-41c3-95fd-694d0127c600 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1" status: 404 len: 111 microversion: 2.1 time: 0.030832 Jul 20 17:56:35.018064 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 450/911] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:34 2022] GET /compute/v2.1/servers/a959b594-9ce2-4fb1-b648-4016dfecb1b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:56:36.294466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:36.294963 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:36.301419 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:36.301860 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:36.302667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:36.303712 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:36.321996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 HTTP/1.1 Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:56:36.323805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.325375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'b8a9d731-6fac-4e62-a247-194eb02970a2'} Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:36.326792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.328384 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.330452 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:36.331589 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2ef47f24-e906-40bf-812c-c602dc9957fb tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 404 len: 111 microversion: 2.1 time: 0.041466 Jul 20 17:56:36.332149 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 462/912] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:56:36 2022] DELETE /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:56:36.340634 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:36.341354 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] [instance: b8a9d731-6fac-4e62-a247-194eb02970a2] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:36.347794 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:36.348238 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:36.349036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:36.349493 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:36.363685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] HTTP exception thrown: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Request method failure captured: Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 HTTP/1.1 Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAsmxFzYlyvf1pmd15Ly0CR8WZvkcqaIWBwLUVr8g3Cc9-ekoKNTpreyonw1QpXVEaN5u--sP9FJaBTl7dULeub0P6RG4STqEzejv-8e4SOVrYgEj53qw6h9Nu5J6JCH_lwiNXvJszyl6TdntLtw2ddPiZg5bRXad0wZSYsqpiUMsc Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:56:36.365232 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93918dc6b6f445d18a3ecb003524152d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93918dc6b6f445d18a3ecb003524152d"}]}] Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 93918dc6b6f445d18a3ecb003524152d Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1019082543 Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 3077a7934f9c4407a70a8790b8da9cde Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeNegativeTest-1019082543-project Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.366904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'b8a9d731-6fac-4e62-a247-194eb02970a2'} Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:36.367882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. Jul 20 17:56:36.369384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:36.370718 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] Returning 404 to user: Instance b8a9d731-6fac-4e62-a247-194eb02970a2 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:36.370718 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-32865c1b-3acb-43fa-beb3-5d7fed5bd3e6 tempest-AttachVolumeNegativeTest-1019082543 tempest-AttachVolumeNegativeTest-1019082543-project] 10.222.0.42 "GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2" status: 404 len: 111 microversion: 2.1 time: 0.030093 Jul 20 17:56:36.370718 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 451/913] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:56:36 2022] GET /compute/v2.1/servers/b8a9d731-6fac-4e62-a247-194eb02970a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:56:50.918876 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ddb571c1-9ef7-486b-9d98-14cb009eaea0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:50.919728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ddb571c1-9ef7-486b-9d98-14cb009eaea0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:50.922669 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:50.923673 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:50.942108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ddb571c1-9ef7-486b-9d98-14cb009eaea0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:50.942715 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ddb571c1-9ef7-486b-9d98-14cb009eaea0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:50.944765 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ddb571c1-9ef7-486b-9d98-14cb009eaea0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:50.945325 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ddb571c1-9ef7-486b-9d98-14cb009eaea0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:50.989190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ddb571c1-9ef7-486b-9d98-14cb009eaea0 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071488 Jul 20 17:56:50.989327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 463/914] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jul 20 17:56:50 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:56:51.058153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-45812638-2176-41f4-ae05-454577bf4a2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:51.058728 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-45812638-2176-41f4-ae05-454577bf4a2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:51.061774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:51.064143 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=89 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:56:51.076968 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-45812638-2176-41f4-ae05-454577bf4a2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:51.081094 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-45812638-2176-41f4-ae05-454577bf4a2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:51.083150 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-45812638-2176-41f4-ae05-454577bf4a2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:51.083724 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-45812638-2176-41f4-ae05-454577bf4a2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:51.124566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-45812638-2176-41f4-ae05-454577bf4a2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:56:51.424915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-45812638-2176-41f4-ae05-454577bf4a2c tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 204 len: 0 microversion: 2.20 time: 0.367365 Jul 20 17:56:51.424915 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 452/915] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jul 20 17:56:51 2022] DELETE /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 17:56:51.432176 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:51.432821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:51.439439 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:51.440173 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:51.441355 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:51.442417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:51.604718 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:51.614518 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:51.617254 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:51.622148 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-8d8b4209-d5fa-497e-b013-1c0cf92c4e89 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.195103 Jul 20 17:56:51.623937 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 464/916] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:51 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:52.644411 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:52.645170 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:52.655511 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:52.655969 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:52.656780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:52.657227 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:52.809598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:52.818760 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:52.820292 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:52.821487 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7837ef56-cdef-436e-9bf3-52e2d10410ae tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.182136 Jul 20 17:56:52.822036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 453/917] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:52 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:53.840108 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:53.841604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:53.854153 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:53.855399 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:53.856557 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:53.857205 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:54.116198 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:54.125231 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:54.126960 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:54.128406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-46e4ce7f-6495-4fc7-9d5e-c5e05c16896a tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1721 microversion: 2.20 time: 0.292556 Jul 20 17:56:54.129240 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 465/918] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:53 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:54.372838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-a05566cc-62d4-4841-9223-9b32a0b91b11 req-3f0e7765-9f0c-4f1b-88e7-4306807fb97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e70e71-0f97-4e13-8c1b-88944978cb60", "name": "network-vif-deleted", "tag": "c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:56:54.417847 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-a05566cc-62d4-4841-9223-9b32a0b91b11 req-3f0e7765-9f0c-4f1b-88e7-4306807fb97a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:54.418329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-a05566cc-62d4-4841-9223-9b32a0b91b11 req-3f0e7765-9f0c-4f1b-88e7-4306807fb97a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:54.451853 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-a05566cc-62d4-4841-9223-9b32a0b91b11 req-3f0e7765-9f0c-4f1b-88e7-4306807fb97a service nova] Creating event network-vif-deleted:c8ed4dc3-2eab-4ce7-803c-a6f24585e5b9 for instance 08e70e71-0f97-4e13-8c1b-88944978cb60 on hv-cinder-84984 Jul 20 17:56:54.483800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-a05566cc-62d4-4841-9223-9b32a0b91b11 req-3f0e7765-9f0c-4f1b-88e7-4306807fb97a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110803 Jul 20 17:56:54.485315 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 454/919] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:56:55.159069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:55.159069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:55.159069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:55.160057 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:55.161147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:55.162481 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:55.226903 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:55.229518 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:55.233617 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lazy-loading 'fault' on Instance uuid 08e70e71-0f97-4e13-8c1b-88944978cb60 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:56:55.339855 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:55.420753 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:55.425749 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '311c19d7062648f78ba4c2090c58f14d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0c8bf2bfe34311961a4bde7f102944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:56:55.427800 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e0f3a718-e799-4e5b-9f8d-19518f7d981e tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 200 len: 1370 microversion: 2.20 time: 0.284444 Jul 20 17:56:55.429258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 466/920] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:55 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 17:56:56.447457 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:56.448764 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:56.455521 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:56.455969 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:56.456784 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:56.457224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:56.471512 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] HTTP exception thrown: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Request method failure captured: Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 HTTP/1.1 Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAqloBZOT8QeovWPr-bw3m76YmkP0503m5Fpqk8p6pC3U6Bf0ey9D1vsdxbeiM1VTM8LcaKNav7MrL62AFdB_sPcU-OUZr1miKNPxqMMI3TlvuK6vG6ZQsWRtIb5GMvHC3sa6wlQddVmbLeFqxO3AN3QKazvkvDccHE_3_cv6-aBXQ Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:56:56.473225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e0c8bf2bfe34311961a4bde7f102944"}]}] Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 311c19d7062648f78ba4c2090c58f14d Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:56.474903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '08e70e71-0f97-4e13-8c1b-88944978cb60'} Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:56.475685 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:56.477812 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:56.479323 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Returning 404 to user: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:56.479323 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fe8dc08b-0418-470c-8044-472694364b9f tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 404 len: 111 microversion: 2.20 time: 0.031986 Jul 20 17:56:56.481390 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 455/921] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:56 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:56:56.485609 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ecd880d3-a801-4109-96dc-16d882372265 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '.version_select at 0x7f7d3d7a0f70>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:56.605762 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ecd880d3-a801-4109-96dc-16d882372265 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163084106" status: 204 len: 0 microversion: 2.20 time: 0.124902 Jul 20 17:56:56.606334 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 467/922] 10.222.0.42 () {60 vars in 1258 bytes} [Wed Jul 20 17:56:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163084106 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 17:56:59.154398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:59.154959 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:59.165551 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:59.166346 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:59.167874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:59.168508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:59.184719 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] HTTP exception thrown: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Request method failure captured: Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: DELETE /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 HTTP/1.1 Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAqloBZOT8QeovWPr-bw3m76YmkP0503m5Fpqk8p6pC3U6Bf0ey9D1vsdxbeiM1VTM8LcaKNav7MrL62AFdB_sPcU-OUZr1miKNPxqMMI3TlvuK6vG6ZQsWRtIb5GMvHC3sa6wlQddVmbLeFqxO3AN3QKazvkvDccHE_3_cv6-aBXQ Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:56:59.187358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e0c8bf2bfe34311961a4bde7f102944"}]}] Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 311c19d7062648f78ba4c2090c58f14d Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.188883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '08e70e71-0f97-4e13-8c1b-88944978cb60'} Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:59.189774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.191178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.194244 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Returning 404 to user: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:59.195264 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e7436f38-ab53-4128-817a-50764b8a50d5 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 404 len: 111 microversion: 2.20 time: 0.046170 Jul 20 17:56:59.195986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 456/923] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jul 20 17:56:59 2022] DELETE /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:56:59.205881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:56:59.205881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 08e70e71-0f97-4e13-8c1b-88944978cb60] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:56:59.218927 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:59.219369 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:59.220156 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:56:59.220627 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:56:59.242696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] HTTP exception thrown: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Request method failure captured: Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 HTTP/1.1 Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAqloBZOT8QeovWPr-bw3m76YmkP0503m5Fpqk8p6pC3U6Bf0ey9D1vsdxbeiM1VTM8LcaKNav7MrL62AFdB_sPcU-OUZr1miKNPxqMMI3TlvuK6vG6ZQsWRtIb5GMvHC3sa6wlQddVmbLeFqxO3AN3QKazvkvDccHE_3_cv6-aBXQ Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:56:59.244404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e0c8bf2bfe34311961a4bde7f102944"}]}] Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 311c19d7062648f78ba4c2090c58f14d Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.245891 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '08e70e71-0f97-4e13-8c1b-88944978cb60'} Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:56:59.246651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. Jul 20 17:56:59.247911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:56:59.249086 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Returning 404 to user: Instance 08e70e71-0f97-4e13-8c1b-88944978cb60 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:56:59.249086 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3e406094-a33b-491c-b321-f96618228bb8 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60" status: 404 len: 111 microversion: 2.20 time: 0.045633 Jul 20 17:56:59.249086 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 468/924] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:56:59 2022] GET /compute/v2.1/servers/08e70e71-0f97-4e13-8c1b-88944978cb60 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 17:57:00.229026 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-28b58a2d-7c60-4170-a68a-291e468dc777 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Action: 'create', calling method: .version_select at 0x7f7d3de33d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-240885777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcqxMnVj1XE6/z4dgDFqk2jkLjAcyCFiDEH7/8vcIM0jO1hz5r/RSAXTq30mg1FFB9yrRFCx7TsZOG0dwVe0Q8XjfK7THlYI+rVrd4gbLiZuJ0PaS6EB5P8Bccgo/7UgA=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:00.242717 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-28b58a2d-7c60-4170-a68a-291e468dc777 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Getting quotas for project be1213650f38494aa2aeb1aadc7ccbc7. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:57:00.246567 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-28b58a2d-7c60-4170-a68a-291e468dc777 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Getting quotas for user 9c95e9df33ad4f819f26fb8b695df7e9 and project be1213650f38494aa2aeb1aadc7ccbc7. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:57:00.340722 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-28b58a2d-7c60-4170-a68a-291e468dc777 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.285748 Jul 20 17:57:00.341372 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 457/925] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 17:57:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:57:00.564764 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:00.565382 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:00.572992 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:00.573585 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:00.574400 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:00.574828 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:00.591450 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] HTTP exception thrown: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Request method failure captured: Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 HTTP/1.1 Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EAqloBZOT8QeovWPr-bw3m76YmkP0503m5Fpqk8p6pC3U6Bf0ey9D1vsdxbeiM1VTM8LcaKNav7MrL62AFdB_sPcU-OUZr1miKNPxqMMI3TlvuK6vG6ZQsWRtIb5GMvHC3sa6wlQddVmbLeFqxO3AN3QKazvkvDccHE_3_cv6-aBXQ Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:57:00.593282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e0c8bf2bfe34311961a4bde7f102944"}]}] Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 311c19d7062648f78ba4c2090c58f14d Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '45b246c9-d9df-4348-9d5a-61c1170b1951'} Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:57:00.595434 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.597024 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.599373 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Returning 404 to user: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:57:00.600389 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-77642e88-b46b-41da-96d1-94474a67a360 tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "DELETE /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 404 len: 111 microversion: 2.20 time: 0.039624 Jul 20 17:57:00.601009 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 469/926] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jul 20 17:57:00 2022] DELETE /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:57:00.609735 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:00.610494 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] [instance: 45b246c9-d9df-4348-9d5a-61c1170b1951] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:00.618882 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:00.619295 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:00.620078 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:00.621537 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:00.637248 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] HTTP exception thrown: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Request method failure captured: Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 HTTP/1.1 Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EAqloBZOT8QeovWPr-bw3m76YmkP0503m5Fpqk8p6pC3U6Bf0ey9D1vsdxbeiM1VTM8LcaKNav7MrL62AFdB_sPcU-OUZr1miKNPxqMMI3TlvuK6vG6ZQsWRtIb5GMvHC3sa6wlQddVmbLeFqxO3AN3QKazvkvDccHE_3_cv6-aBXQ Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 17:57:00.638800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e0c8bf2bfe34311961a4bde7f102944"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e0c8bf2bfe34311961a4bde7f102944"}]}] Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 1e0c8bf2bfe34311961a4bde7f102944 Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116953909 Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 311c19d7062648f78ba4c2090c58f14d Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116953909-project Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.640320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '45b246c9-d9df-4348-9d5a-61c1170b1951'} Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:57:00.641106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. Jul 20 17:57:00.642334 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 17:57:00.643479 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] Returning 404 to user: Instance 45b246c9-d9df-4348-9d5a-61c1170b1951 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:57:00.643479 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2b3926cf-3b4f-447c-91a4-979b4c17fa7d tempest-AttachVolumeShelveTestJSON-1116953909 tempest-AttachVolumeShelveTestJSON-1116953909-project] 10.222.0.42 "GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951" status: 404 len: 111 microversion: 2.20 time: 0.035131 Jul 20 17:57:00.643479 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 458/927] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jul 20 17:57:00 2022] GET /compute/v2.1/servers/45b246c9-d9df-4348-9d5a-61c1170b1951 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 17:57:13.639186 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:13.640552 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=30 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:13.760333 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b19e0d80-3c2e-49b9-98b2-2aeedb5b93e2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'create', calling method: .version_select at 0x7f7d3d6f30d0>, body: {"keypair": {"name": "tempest-keypair-614733709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeI6/mhbF4ONQnxw+9nPrJU/4/hMT1goM9p2xRXkuSM/uXxa/Be52gZqek5U5+fr8VvZtov8wkLQ2AJr4E9m/hBIP54MYKuHr8rfbJYk/++fKSMoyMLrPnx2q0I4OH2zA=="}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:13.779736 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-b19e0d80-3c2e-49b9-98b2-2aeedb5b93e2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Getting quotas for project 958d3fd7755a4e0b8419e92a26656e2d. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:57:13.785929 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-b19e0d80-3c2e-49b9-98b2-2aeedb5b93e2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Getting quotas for user de1ce4a75440478d957a3a03d41dbffd and project 958d3fd7755a4e0b8419e92a26656e2d. Resources: {'key_pairs'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:57:13.872684 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b19e0d80-3c2e-49b9-98b2-2aeedb5b93e2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.239322 Jul 20 17:57:13.873275 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 470/928] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 17:57:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:57:16.559647 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1534315079", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5841bc30-6bad-4d17-a6eb-d05a9884e54b"}], "security_groups": [{"name": "tempest-securitygroup--2092367273"}], "key_name": "tempest-keypair-614733709", "user_data": "}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:16.566948 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=4 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:16.568500 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:16.569145 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:16.669458 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] validate_networks() for [('5841bc30-6bad-4d17-a6eb-d05a9884e54b', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:57:17.067802 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:57:17.068807 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:57:17.069281 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:57:17.069695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:57:17.070109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:57:17.079153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:17.079612 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:17.080450 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:17.080900 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:17.099597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Getting quotas for project 958d3fd7755a4e0b8419e92a26656e2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:57:17.107316 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Getting quotas for user de1ce4a75440478d957a3a03d41dbffd and project 958d3fd7755a4e0b8419e92a26656e2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:57:17.122827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:57:17.125143 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:57:17.275447 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-20def32d-be50-49bc-a589-b57f916973ae tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.720101 Jul 20 17:57:17.276098 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 459/929] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:57:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:57:17.286615 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e463570c-fa78-4ac3-9baf-e2b2cc110523 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:17.287390 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e463570c-fa78-4ac3-9baf-e2b2cc110523 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:17.343931 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e463570c-fa78-4ac3-9baf-e2b2cc110523 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:17.351031 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e463570c-fa78-4ac3-9baf-e2b2cc110523 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1237 microversion: 2.1 time: 0.068860 Jul 20 17:57:17.351673 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 471/930] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:17 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:18.367971 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0d0c28ae-3a3b-4c2b-bbf6-017578b88e83 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:18.368792 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0d0c28ae-3a3b-4c2b-bbf6-017578b88e83 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:18.420876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0d0c28ae-3a3b-4c2b-bbf6-017578b88e83 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:18.428965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0d0c28ae-3a3b-4c2b-bbf6-017578b88e83 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1237 microversion: 2.1 time: 0.065735 Jul 20 17:57:18.429525 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 460/931] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:18 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:19.446691 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2b64c37d-c06b-4cf0-9b5b-6338d8ff657d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:19.447320 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2b64c37d-c06b-4cf0-9b5b-6338d8ff657d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:19.454506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b64c37d-c06b-4cf0-9b5b-6338d8ff657d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:19.454955 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b64c37d-c06b-4cf0-9b5b-6338d8ff657d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:19.455786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b64c37d-c06b-4cf0-9b5b-6338d8ff657d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:19.456233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2b64c37d-c06b-4cf0-9b5b-6338d8ff657d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:19.517680 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2b64c37d-c06b-4cf0-9b5b-6338d8ff657d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:19.525491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2b64c37d-c06b-4cf0-9b5b-6338d8ff657d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1233 microversion: 2.1 time: 0.083668 Jul 20 17:57:19.526484 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 472/932] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:19 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:20.543024 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4cca4d72-ba44-4c3d-9f85-8d943994f66b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:20.543643 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4cca4d72-ba44-4c3d-9f85-8d943994f66b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:20.550699 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4cca4d72-ba44-4c3d-9f85-8d943994f66b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:20.551010 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4cca4d72-ba44-4c3d-9f85-8d943994f66b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:20.551735 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4cca4d72-ba44-4c3d-9f85-8d943994f66b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:20.552744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4cca4d72-ba44-4c3d-9f85-8d943994f66b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:20.627845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4cca4d72-ba44-4c3d-9f85-8d943994f66b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:20.635896 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4cca4d72-ba44-4c3d-9f85-8d943994f66b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1297 microversion: 2.1 time: 0.096845 Jul 20 17:57:20.636585 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 461/933] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:20 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:21.653148 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-fe94fabc-14aa-44fb-8521-e334af701c33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:21.653892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-fe94fabc-14aa-44fb-8521-e334af701c33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:21.660576 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fe94fabc-14aa-44fb-8521-e334af701c33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:21.661015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fe94fabc-14aa-44fb-8521-e334af701c33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:21.662398 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fe94fabc-14aa-44fb-8521-e334af701c33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:21.662828 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-fe94fabc-14aa-44fb-8521-e334af701c33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:21.801749 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-fe94fabc-14aa-44fb-8521-e334af701c33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:21.817877 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-fe94fabc-14aa-44fb-8521-e334af701c33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1363 microversion: 2.1 time: 0.168315 Jul 20 17:57:21.826782 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 473/934] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:21 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:22.533041 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-545a05ee-48c3-4f11-b6b6-11472d3e0934 req-606b3523-205a-493f-b356-388833ebfce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0962b1-c468-4a10-9a82-363f867efe92", "tag": "5e2b818c-70ef-44b0-af2e-182b4029ca2f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:22.542491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-545a05ee-48c3-4f11-b6b6-11472d3e0934 req-606b3523-205a-493f-b356-388833ebfce8 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:22.542936 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-545a05ee-48c3-4f11-b6b6-11472d3e0934 req-606b3523-205a-493f-b356-388833ebfce8 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:22.565641 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-545a05ee-48c3-4f11-b6b6-11472d3e0934 req-606b3523-205a-493f-b356-388833ebfce8 service nova] Creating event network-changed:5e2b818c-70ef-44b0-af2e-182b4029ca2f for instance 2b0962b1-c468-4a10-9a82-363f867efe92 on hv-cinder-84984 Jul 20 17:57:22.565818 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-545a05ee-48c3-4f11-b6b6-11472d3e0934 req-606b3523-205a-493f-b356-388833ebfce8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036548 Jul 20 17:57:22.566424 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 462/935] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:57:22.840328 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-705477e7-6f1a-44db-97dc-89a91624a529 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:22.841265 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-705477e7-6f1a-44db-97dc-89a91624a529 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:22.846939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-705477e7-6f1a-44db-97dc-89a91624a529 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:22.847453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-705477e7-6f1a-44db-97dc-89a91624a529 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:22.848551 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-705477e7-6f1a-44db-97dc-89a91624a529 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:22.849150 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-705477e7-6f1a-44db-97dc-89a91624a529 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:22.985552 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-705477e7-6f1a-44db-97dc-89a91624a529 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:23.001798 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-705477e7-6f1a-44db-97dc-89a91624a529 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1363 microversion: 2.1 time: 0.166019 Jul 20 17:57:23.002855 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 474/936] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:22 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:24.020262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9082d54f-d50c-4bc5-8b1c-f130c2b13337 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:24.021564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9082d54f-d50c-4bc5-8b1c-f130c2b13337 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:24.028120 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9082d54f-d50c-4bc5-8b1c-f130c2b13337 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:24.028616 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9082d54f-d50c-4bc5-8b1c-f130c2b13337 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:24.029380 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9082d54f-d50c-4bc5-8b1c-f130c2b13337 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:24.029819 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9082d54f-d50c-4bc5-8b1c-f130c2b13337 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:24.164307 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9082d54f-d50c-4bc5-8b1c-f130c2b13337 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:24.171794 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9082d54f-d50c-4bc5-8b1c-f130c2b13337 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1363 microversion: 2.1 time: 0.156219 Jul 20 17:57:24.172355 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 463/937] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:24 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:25.189507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6cf81fdd-a6c2-40a7-8afd-d6b9aef50147 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:25.190146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6cf81fdd-a6c2-40a7-8afd-d6b9aef50147 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:25.196616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6cf81fdd-a6c2-40a7-8afd-d6b9aef50147 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:25.197299 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6cf81fdd-a6c2-40a7-8afd-d6b9aef50147 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:25.198026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6cf81fdd-a6c2-40a7-8afd-d6b9aef50147 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:25.198459 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6cf81fdd-a6c2-40a7-8afd-d6b9aef50147 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:25.325827 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-867044408", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-240885777", "security_groups": [{"name": "tempest-secgroup-smoke-1389441536"}], "block_device_mapping_v2": [{"uuid": "8715c484-a269-4e30-bd2c-1704a5a4d75e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d856af6c-3171-430a-a397-90532200f85e"}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:25.327258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6cf81fdd-a6c2-40a7-8afd-d6b9aef50147 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:25.335133 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6cf81fdd-a6c2-40a7-8afd-d6b9aef50147 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1363 microversion: 2.1 time: 0.149803 Jul 20 17:57:25.335695 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 475/938] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:25 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:25.439734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] validate_networks() for [('d856af6c-3171-430a-a397-90532200f85e', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:57:25.815775 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:57:25.816254 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:57:25.816761 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:57:25.817178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:57:25.817854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:57:25.826678 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:25.827133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:25.827945 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:25.830098 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:25.845347 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Getting quotas for project be1213650f38494aa2aeb1aadc7ccbc7. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:57:25.849464 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Getting quotas for user 9c95e9df33ad4f819f26fb8b695df7e9 and project be1213650f38494aa2aeb1aadc7ccbc7. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:57:25.907248 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:57:25.909367 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8715c484-a269-4e30-bd2c-1704a5a4d75e',volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:57:26.353011 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-545c7d71-0028-4616-a457-dfe2f5e38b6f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:26.353011 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-545c7d71-0028-4616-a457-dfe2f5e38b6f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:26.358848 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-545c7d71-0028-4616-a457-dfe2f5e38b6f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:26.359598 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-545c7d71-0028-4616-a457-dfe2f5e38b6f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:26.360156 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-545c7d71-0028-4616-a457-dfe2f5e38b6f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:26.360525 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-545c7d71-0028-4616-a457-dfe2f5e38b6f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:26.504341 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-545c7d71-0028-4616-a457-dfe2f5e38b6f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:26.512229 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-545c7d71-0028-4616-a457-dfe2f5e38b6f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1363 microversion: 2.1 time: 0.165112 Jul 20 17:57:26.512812 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 476/939] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:26 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:57:26.585917 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2bbaa471-ddc5-4dc9-8e36-e0f6e3adb2fd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.264257 Jul 20 17:57:26.586571 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 464/940] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:57:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 17:57:26.596414 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b5d3ff78-8e5f-42dc-ab1f-8b1e63a731a0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:26.597040 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b5d3ff78-8e5f-42dc-ab1f-8b1e63a731a0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:26.650759 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b5d3ff78-8e5f-42dc-ab1f-8b1e63a731a0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:26.657597 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b5d3ff78-8e5f-42dc-ab1f-8b1e63a731a0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1093 microversion: 2.1 time: 0.065094 Jul 20 17:57:26.658322 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 477/941] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:26 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:27.530263 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6188ca71-4816-4df8-8022-8772a3cced33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:27.531141 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6188ca71-4816-4df8-8022-8772a3cced33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:27.538489 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6188ca71-4816-4df8-8022-8772a3cced33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:27.543777 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6188ca71-4816-4df8-8022-8772a3cced33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:27.543777 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6188ca71-4816-4df8-8022-8772a3cced33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:27.543777 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6188ca71-4816-4df8-8022-8772a3cced33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:27.669771 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6188ca71-4816-4df8-8022-8772a3cced33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:27.674981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-320736e1-5b2d-4b05-99e8-d5c3c599b34e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:27.675841 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-320736e1-5b2d-4b05-99e8-d5c3c599b34e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:27.678792 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6188ca71-4816-4df8-8022-8772a3cced33 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1363 microversion: 2.1 time: 0.152819 Jul 20 17:57:27.690445 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 465/942] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:27 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:27.734130 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-320736e1-5b2d-4b05-99e8-d5c3c599b34e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:27.741663 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-320736e1-5b2d-4b05-99e8-d5c3c599b34e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1093 microversion: 2.1 time: 0.071157 Jul 20 17:57:27.742217 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 478/943] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:27 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:57:28.371282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-be6c3136-de25-4e50-ab78-b4f066b0c0b1 req-0291e99f-21ac-4a84-a815-be048fc1929c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0962b1-c468-4a10-9a82-363f867efe92", "name": "network-vif-plugged", "status": "completed", "tag": "5e2b818c-70ef-44b0-af2e-182b4029ca2f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:28.379745 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-be6c3136-de25-4e50-ab78-b4f066b0c0b1 req-0291e99f-21ac-4a84-a815-be048fc1929c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:28.380608 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-be6c3136-de25-4e50-ab78-b4f066b0c0b1 req-0291e99f-21ac-4a84-a815-be048fc1929c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:28.392973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-be6c3136-de25-4e50-ab78-b4f066b0c0b1 req-0291e99f-21ac-4a84-a815-be048fc1929c service nova] Creating event network-vif-plugged:5e2b818c-70ef-44b0-af2e-182b4029ca2f for instance 2b0962b1-c468-4a10-9a82-363f867efe92 on hv-cinder-84984 Jul 20 17:57:28.398342 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-be6c3136-de25-4e50-ab78-b4f066b0c0b1 req-0291e99f-21ac-4a84-a815-be048fc1929c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031212 Jul 20 17:57:28.398939 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 466/944] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:57:28.699498 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-641ec5f4-67ce-46b2-8052-bff7b4b0f854 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:28.699498 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-641ec5f4-67ce-46b2-8052-bff7b4b0f854 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:28.703233 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-641ec5f4-67ce-46b2-8052-bff7b4b0f854 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:28.703739 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-641ec5f4-67ce-46b2-8052-bff7b4b0f854 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:28.704746 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-641ec5f4-67ce-46b2-8052-bff7b4b0f854 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:28.705131 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-641ec5f4-67ce-46b2-8052-bff7b4b0f854 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:28.758998 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-609a9054-5c8a-4d4f-a7ff-b6aa8509be7e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:28.759706 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-609a9054-5c8a-4d4f-a7ff-b6aa8509be7e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:28.766925 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-609a9054-5c8a-4d4f-a7ff-b6aa8509be7e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:28.767382 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-609a9054-5c8a-4d4f-a7ff-b6aa8509be7e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:28.768344 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-609a9054-5c8a-4d4f-a7ff-b6aa8509be7e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:28.769002 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-609a9054-5c8a-4d4f-a7ff-b6aa8509be7e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:28.881358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-609a9054-5c8a-4d4f-a7ff-b6aa8509be7e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:28.889378 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-609a9054-5c8a-4d4f-a7ff-b6aa8509be7e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1135 microversion: 2.1 time: 0.134738 Jul 20 17:57:28.889949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 467/945] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:28 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1135 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:57:28.917327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-641ec5f4-67ce-46b2-8052-bff7b4b0f854 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:28.924859 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-641ec5f4-67ce-46b2-8052-bff7b4b0f854 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1363 microversion: 2.1 time: 0.233347 Jul 20 17:57:28.925428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 479/946] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:28 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:29.906619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b9215af1-7f8c-4079-8f93-b3bcd99d010c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:29.907479 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b9215af1-7f8c-4079-8f93-b3bcd99d010c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:29.914455 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b9215af1-7f8c-4079-8f93-b3bcd99d010c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:29.914901 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b9215af1-7f8c-4079-8f93-b3bcd99d010c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:29.915649 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b9215af1-7f8c-4079-8f93-b3bcd99d010c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:29.916080 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b9215af1-7f8c-4079-8f93-b3bcd99d010c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:29.941802 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-e2b27308-912f-45eb-a371-f2bbc73f2b46 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:29.943519 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-e2b27308-912f-45eb-a371-f2bbc73f2b46 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:29.950492 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e2b27308-912f-45eb-a371-f2bbc73f2b46 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:29.957464 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e2b27308-912f-45eb-a371-f2bbc73f2b46 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:29.957464 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e2b27308-912f-45eb-a371-f2bbc73f2b46 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:29.957464 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-e2b27308-912f-45eb-a371-f2bbc73f2b46 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:29.979475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b9215af1-7f8c-4079-8f93-b3bcd99d010c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:29.987050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b9215af1-7f8c-4079-8f93-b3bcd99d010c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1191 microversion: 2.1 time: 0.084241 Jul 20 17:57:29.987619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 468/947] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:29 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:30.093720 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-e2b27308-912f-45eb-a371-f2bbc73f2b46 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:30.101776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-e2b27308-912f-45eb-a371-f2bbc73f2b46 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1363 microversion: 2.1 time: 0.163802 Jul 20 17:57:30.116479 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 480/948] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:29 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:57:31.003751 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c87bd3a9-00b7-4445-8c45-3d984cecdcd7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:31.004365 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c87bd3a9-00b7-4445-8c45-3d984cecdcd7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:31.011347 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c87bd3a9-00b7-4445-8c45-3d984cecdcd7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:31.011814 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c87bd3a9-00b7-4445-8c45-3d984cecdcd7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:31.012584 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c87bd3a9-00b7-4445-8c45-3d984cecdcd7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:31.013024 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c87bd3a9-00b7-4445-8c45-3d984cecdcd7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:31.075804 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c87bd3a9-00b7-4445-8c45-3d984cecdcd7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:31.083206 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c87bd3a9-00b7-4445-8c45-3d984cecdcd7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1199 microversion: 2.1 time: 0.083315 Jul 20 17:57:31.084279 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 469/949] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:30 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1199 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:31.124832 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a48eb553-9a31-45e5-ad5e-6f8b4c00db66 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:31.125565 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a48eb553-9a31-45e5-ad5e-6f8b4c00db66 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:31.132655 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a48eb553-9a31-45e5-ad5e-6f8b4c00db66 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:31.133103 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a48eb553-9a31-45e5-ad5e-6f8b4c00db66 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:31.133865 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a48eb553-9a31-45e5-ad5e-6f8b4c00db66 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:31.134346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a48eb553-9a31-45e5-ad5e-6f8b4c00db66 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:31.271440 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a48eb553-9a31-45e5-ad5e-6f8b4c00db66 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:31.278870 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a48eb553-9a31-45e5-ad5e-6f8b4c00db66 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1549 microversion: 2.1 time: 0.157873 Jul 20 17:57:31.279435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 481/950] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:31 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:31.294746 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b85d1a1c-f057-4fa3-9bb7-c3007b6def61 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:31.295233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b85d1a1c-f057-4fa3-9bb7-c3007b6def61 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:31.301266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b85d1a1c-f057-4fa3-9bb7-c3007b6def61 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:31.301712 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b85d1a1c-f057-4fa3-9bb7-c3007b6def61 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:31.302959 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b85d1a1c-f057-4fa3-9bb7-c3007b6def61 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:31.303392 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b85d1a1c-f057-4fa3-9bb7-c3007b6def61 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:31.377697 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b85d1a1c-f057-4fa3-9bb7-c3007b6def61 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086739 Jul 20 17:57:31.378290 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 470/951] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jul 20 17:57:31 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:57:32.100515 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b044a9f2-a854-43f8-89f8-7c52abd74653 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:32.101128 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b044a9f2-a854-43f8-89f8-7c52abd74653 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:32.107236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b044a9f2-a854-43f8-89f8-7c52abd74653 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:32.107683 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b044a9f2-a854-43f8-89f8-7c52abd74653 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:32.108466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b044a9f2-a854-43f8-89f8-7c52abd74653 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:32.108903 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b044a9f2-a854-43f8-89f8-7c52abd74653 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:32.192158 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b044a9f2-a854-43f8-89f8-7c52abd74653 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:32.200123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b044a9f2-a854-43f8-89f8-7c52abd74653 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1199 microversion: 2.1 time: 0.103506 Jul 20 17:57:32.200729 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 482/952] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:32 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1199 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:32.396649 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-f53ab44f-860b-48a4-97c2-e52dfa0aec14 req-cddfad54-264b-49cf-b2bb-43b6a6c36c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0962b1-c468-4a10-9a82-363f867efe92", "tag": "5e2b818c-70ef-44b0-af2e-182b4029ca2f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:32.404964 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f53ab44f-860b-48a4-97c2-e52dfa0aec14 req-cddfad54-264b-49cf-b2bb-43b6a6c36c3c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:32.405408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f53ab44f-860b-48a4-97c2-e52dfa0aec14 req-cddfad54-264b-49cf-b2bb-43b6a6c36c3c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:32.416799 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-f53ab44f-860b-48a4-97c2-e52dfa0aec14 req-cddfad54-264b-49cf-b2bb-43b6a6c36c3c service nova] Creating event network-changed:5e2b818c-70ef-44b0-af2e-182b4029ca2f for instance 2b0962b1-c468-4a10-9a82-363f867efe92 on hv-cinder-84984 Jul 20 17:57:32.422594 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-f53ab44f-860b-48a4-97c2-e52dfa0aec14 req-cddfad54-264b-49cf-b2bb-43b6a6c36c3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030110 Jul 20 17:57:32.423186 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 471/953] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:57:33.235153 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-56ee521f-06c6-4473-af32-3cebf5c00c10 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:33.236659 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-56ee521f-06c6-4473-af32-3cebf5c00c10 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:33.255411 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56ee521f-06c6-4473-af32-3cebf5c00c10 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:33.259771 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56ee521f-06c6-4473-af32-3cebf5c00c10 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:33.261046 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56ee521f-06c6-4473-af32-3cebf5c00c10 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:33.261734 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-56ee521f-06c6-4473-af32-3cebf5c00c10 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:33.369879 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-56ee521f-06c6-4473-af32-3cebf5c00c10 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:33.381667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-56ee521f-06c6-4473-af32-3cebf5c00c10 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1199 microversion: 2.1 time: 0.168266 Jul 20 17:57:33.384215 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 483/954] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:33 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1199 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:34.400196 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-389eac3f-e259-4282-b90c-b219654ea5e7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:34.408838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-389eac3f-e259-4282-b90c-b219654ea5e7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:34.420536 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-389eac3f-e259-4282-b90c-b219654ea5e7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:34.421000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-389eac3f-e259-4282-b90c-b219654ea5e7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:34.421784 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-389eac3f-e259-4282-b90c-b219654ea5e7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:34.422224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-389eac3f-e259-4282-b90c-b219654ea5e7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:34.585759 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-389eac3f-e259-4282-b90c-b219654ea5e7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:34.594013 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-389eac3f-e259-4282-b90c-b219654ea5e7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1277 microversion: 2.1 time: 0.198799 Jul 20 17:57:34.594678 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 472/955] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:34 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:35.311306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-18592e04-0bc7-4007-af38-9af947b84cd0 req-f02837f2-ab6f-43a2-9d42-829a32bdea10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cbdc617-0892-491a-9baf-97c8bb00d86a", "tag": "f2709eb2-b640-45ce-b047-cd5c831cf094"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:35.324306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-18592e04-0bc7-4007-af38-9af947b84cd0 req-f02837f2-ab6f-43a2-9d42-829a32bdea10 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:35.325175 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-18592e04-0bc7-4007-af38-9af947b84cd0 req-f02837f2-ab6f-43a2-9d42-829a32bdea10 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:35.339959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-18592e04-0bc7-4007-af38-9af947b84cd0 req-f02837f2-ab6f-43a2-9d42-829a32bdea10 service nova] Creating event network-changed:f2709eb2-b640-45ce-b047-cd5c831cf094 for instance 3cbdc617-0892-491a-9baf-97c8bb00d86a on hv-cinder-84984 Jul 20 17:57:35.345416 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-18592e04-0bc7-4007-af38-9af947b84cd0 req-f02837f2-ab6f-43a2-9d42-829a32bdea10 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038804 Jul 20 17:57:35.346105 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 484/956] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:57:35.612299 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6545f10f-7730-4433-940f-7594413e390c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:35.613040 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6545f10f-7730-4433-940f-7594413e390c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:35.620116 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6545f10f-7730-4433-940f-7594413e390c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:35.620625 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6545f10f-7730-4433-940f-7594413e390c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:35.621407 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6545f10f-7730-4433-940f-7594413e390c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:35.621847 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6545f10f-7730-4433-940f-7594413e390c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:35.754330 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6545f10f-7730-4433-940f-7594413e390c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:35.761381 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6545f10f-7730-4433-940f-7594413e390c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1277 microversion: 2.1 time: 0.153005 Jul 20 17:57:35.761951 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 473/957] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:35 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:36.778905 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-65673c98-f241-461c-b8d5-5c25626da114 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:36.779592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-65673c98-f241-461c-b8d5-5c25626da114 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:36.787366 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-65673c98-f241-461c-b8d5-5c25626da114 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:36.787811 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-65673c98-f241-461c-b8d5-5c25626da114 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:36.788722 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-65673c98-f241-461c-b8d5-5c25626da114 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:36.789258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-65673c98-f241-461c-b8d5-5c25626da114 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:36.923105 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-65673c98-f241-461c-b8d5-5c25626da114 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:36.931182 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-65673c98-f241-461c-b8d5-5c25626da114 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.156675 Jul 20 17:57:36.934742 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 485/958] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:36 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:37.948013 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-463feee0-a7dc-488d-bf77-8fe699290373 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:37.948615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-463feee0-a7dc-488d-bf77-8fe699290373 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:37.950535 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=4 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:37.951210 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=14 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:37.956712 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-463feee0-a7dc-488d-bf77-8fe699290373 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:37.957614 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-463feee0-a7dc-488d-bf77-8fe699290373 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:37.958404 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-463feee0-a7dc-488d-bf77-8fe699290373 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:37.958841 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-463feee0-a7dc-488d-bf77-8fe699290373 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:38.089595 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-463feee0-a7dc-488d-bf77-8fe699290373 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:38.097116 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-463feee0-a7dc-488d-bf77-8fe699290373 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.153038 Jul 20 17:57:38.097680 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 474/959] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:37 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:39.114475 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3e17ea17-3111-4650-804f-39899bb81979 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:39.115156 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3e17ea17-3111-4650-804f-39899bb81979 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:39.117144 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=10 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:39.122483 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e17ea17-3111-4650-804f-39899bb81979 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:39.122933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e17ea17-3111-4650-804f-39899bb81979 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:39.123698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e17ea17-3111-4650-804f-39899bb81979 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:39.124136 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e17ea17-3111-4650-804f-39899bb81979 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:39.261978 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3e17ea17-3111-4650-804f-39899bb81979 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:39.269428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3e17ea17-3111-4650-804f-39899bb81979 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.159083 Jul 20 17:57:39.271219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 486/960] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:39 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:40.287743 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6f494903-41dd-48b7-89ce-ab067a47f905 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:40.288476 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6f494903-41dd-48b7-89ce-ab067a47f905 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:40.295348 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f494903-41dd-48b7-89ce-ab067a47f905 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:40.295800 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f494903-41dd-48b7-89ce-ab067a47f905 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:40.296611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f494903-41dd-48b7-89ce-ab067a47f905 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:40.297050 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6f494903-41dd-48b7-89ce-ab067a47f905 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:40.491623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6f494903-41dd-48b7-89ce-ab067a47f905 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:40.499357 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6f494903-41dd-48b7-89ce-ab067a47f905 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.215471 Jul 20 17:57:40.499860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 475/961] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:40 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:41.515722 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-886112f1-7368-439e-aba5-8846fb572253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:41.516332 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-886112f1-7368-439e-aba5-8846fb572253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:41.523340 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-886112f1-7368-439e-aba5-8846fb572253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:41.523786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-886112f1-7368-439e-aba5-8846fb572253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:41.524570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-886112f1-7368-439e-aba5-8846fb572253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:41.525007 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-886112f1-7368-439e-aba5-8846fb572253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:41.657507 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-886112f1-7368-439e-aba5-8846fb572253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:41.665347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-886112f1-7368-439e-aba5-8846fb572253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.153410 Jul 20 17:57:41.665929 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 487/962] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:41 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:42.682583 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c8b9cea5-4ceb-4c65-b5f8-3ff0a533cc04 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:42.686483 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c8b9cea5-4ceb-4c65-b5f8-3ff0a533cc04 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:42.689992 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8b9cea5-4ceb-4c65-b5f8-3ff0a533cc04 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:42.690444 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8b9cea5-4ceb-4c65-b5f8-3ff0a533cc04 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:42.691230 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8b9cea5-4ceb-4c65-b5f8-3ff0a533cc04 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:42.691778 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c8b9cea5-4ceb-4c65-b5f8-3ff0a533cc04 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:42.832182 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c8b9cea5-4ceb-4c65-b5f8-3ff0a533cc04 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:42.840252 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c8b9cea5-4ceb-4c65-b5f8-3ff0a533cc04 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.161529 Jul 20 17:57:42.840850 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 476/963] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:42 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:43.856973 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3127d967-c8ea-4b19-835b-25096e249253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:43.857517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3127d967-c8ea-4b19-835b-25096e249253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:43.859932 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:43.864793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3127d967-c8ea-4b19-835b-25096e249253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:43.865240 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3127d967-c8ea-4b19-835b-25096e249253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:43.866000 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3127d967-c8ea-4b19-835b-25096e249253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:43.866437 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3127d967-c8ea-4b19-835b-25096e249253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:43.872039 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=81 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:44.009216 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3127d967-c8ea-4b19-835b-25096e249253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:44.016613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3127d967-c8ea-4b19-835b-25096e249253 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.163621 Jul 20 17:57:44.017174 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 488/964] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:43 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:45.033899 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-06af7419-3666-49fb-80cb-28ccd955cafd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:45.034477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-06af7419-3666-49fb-80cb-28ccd955cafd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:45.043780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-06af7419-3666-49fb-80cb-28ccd955cafd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:45.043780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-06af7419-3666-49fb-80cb-28ccd955cafd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:45.043780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-06af7419-3666-49fb-80cb-28ccd955cafd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:45.043780 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-06af7419-3666-49fb-80cb-28ccd955cafd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:45.180311 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-06af7419-3666-49fb-80cb-28ccd955cafd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:45.187805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-06af7419-3666-49fb-80cb-28ccd955cafd tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.157836 Jul 20 17:57:45.193304 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 477/965] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:45 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:46.205880 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-605e32cb-9ad5-412d-988e-427895957d93 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:46.206490 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-605e32cb-9ad5-412d-988e-427895957d93 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:46.214083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-605e32cb-9ad5-412d-988e-427895957d93 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:46.214528 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-605e32cb-9ad5-412d-988e-427895957d93 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:46.215440 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-605e32cb-9ad5-412d-988e-427895957d93 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:46.215910 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-605e32cb-9ad5-412d-988e-427895957d93 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:46.355346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-605e32cb-9ad5-412d-988e-427895957d93 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:46.361825 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-605e32cb-9ad5-412d-988e-427895957d93 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.160770 Jul 20 17:57:46.362399 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 489/966] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:46 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:46.485937 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-93db7802-1946-4def-9bd7-24f100a4e6a3 req-09f88cb4-406b-4b8c-b84f-2fc1fb1793e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbdc617-0892-491a-9baf-97c8bb00d86a", "name": "network-vif-plugged", "status": "completed", "tag": "f2709eb2-b640-45ce-b047-cd5c831cf094"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:46.496971 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-93db7802-1946-4def-9bd7-24f100a4e6a3 req-09f88cb4-406b-4b8c-b84f-2fc1fb1793e5 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:46.497411 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-93db7802-1946-4def-9bd7-24f100a4e6a3 req-09f88cb4-406b-4b8c-b84f-2fc1fb1793e5 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:46.508454 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-93db7802-1946-4def-9bd7-24f100a4e6a3 req-09f88cb4-406b-4b8c-b84f-2fc1fb1793e5 service nova] Creating event network-vif-plugged:f2709eb2-b640-45ce-b047-cd5c831cf094 for instance 3cbdc617-0892-491a-9baf-97c8bb00d86a on hv-cinder-84984 Jul 20 17:57:46.513455 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-93db7802-1946-4def-9bd7-24f100a4e6a3 req-09f88cb4-406b-4b8c-b84f-2fc1fb1793e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031700 Jul 20 17:57:46.514031 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 478/967] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:57:47.379205 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-180cf960-0bb3-4a75-965b-e4d37e8e9b29 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:47.379819 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-180cf960-0bb3-4a75-965b-e4d37e8e9b29 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:47.392190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-180cf960-0bb3-4a75-965b-e4d37e8e9b29 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:47.392190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-180cf960-0bb3-4a75-965b-e4d37e8e9b29 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:47.392190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-180cf960-0bb3-4a75-965b-e4d37e8e9b29 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:47.392190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-180cf960-0bb3-4a75-965b-e4d37e8e9b29 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:47.520045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-180cf960-0bb3-4a75-965b-e4d37e8e9b29 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:47.527823 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-180cf960-0bb3-4a75-965b-e4d37e8e9b29 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1265 microversion: 2.1 time: 0.152623 Jul 20 17:57:47.528380 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 490/968] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:47 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:57:48.546325 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c60d94d6-3c60-4aab-9ab3-be2a4a057aa1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:48.547026 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c60d94d6-3c60-4aab-9ab3-be2a4a057aa1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:48.548993 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:48.554554 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c60d94d6-3c60-4aab-9ab3-be2a4a057aa1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:48.554986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c60d94d6-3c60-4aab-9ab3-be2a4a057aa1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:48.555751 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c60d94d6-3c60-4aab-9ab3-be2a4a057aa1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:48.556189 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c60d94d6-3c60-4aab-9ab3-be2a4a057aa1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:48.560527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=89 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:48.696298 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c60d94d6-3c60-4aab-9ab3-be2a4a057aa1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:48.704037 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c60d94d6-3c60-4aab-9ab3-be2a4a057aa1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1451 microversion: 2.1 time: 0.162441 Jul 20 17:57:48.706234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 479/969] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:48 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:48.727833 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1f47864a-40d3-45e0-966e-5b77d3c861f5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:57:48.728456 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1f47864a-40d3-45e0-966e-5b77d3c861f5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:57:48.741703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f47864a-40d3-45e0-966e-5b77d3c861f5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:48.742143 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f47864a-40d3-45e0-966e-5b77d3c861f5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:48.742898 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f47864a-40d3-45e0-966e-5b77d3c861f5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:48.743326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1f47864a-40d3-45e0-966e-5b77d3c861f5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:48.876284 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1f47864a-40d3-45e0-966e-5b77d3c861f5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:57:48.883857 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1f47864a-40d3-45e0-966e-5b77d3c861f5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1451 microversion: 2.1 time: 0.160549 Jul 20 17:57:48.884478 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 491/970] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:57:48 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:57:51.424476 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-b5484b27-7de5-43f1-83cf-d63fc7d89e05 req-e37652a1-e1ea-4ee4-b215-a38342d99061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cbdc617-0892-491a-9baf-97c8bb00d86a", "tag": "f2709eb2-b640-45ce-b047-cd5c831cf094"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:57:51.433761 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-b5484b27-7de5-43f1-83cf-d63fc7d89e05 req-e37652a1-e1ea-4ee4-b215-a38342d99061 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:57:51.445671 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-b5484b27-7de5-43f1-83cf-d63fc7d89e05 req-e37652a1-e1ea-4ee4-b215-a38342d99061 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:57:51.445912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-b5484b27-7de5-43f1-83cf-d63fc7d89e05 req-e37652a1-e1ea-4ee4-b215-a38342d99061 service nova] Creating event network-changed:f2709eb2-b640-45ce-b047-cd5c831cf094 for instance 3cbdc617-0892-491a-9baf-97c8bb00d86a on hv-cinder-84984 Jul 20 17:57:51.450624 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-b5484b27-7de5-43f1-83cf-d63fc7d89e05 req-e37652a1-e1ea-4ee4-b215-a38342d99061 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030469 Jul 20 17:57:51.451224 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 480/971] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:58:08.585413 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c6cd988e-06e3-402d-82fb-b79e4328f524 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:08.585982 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c6cd988e-06e3-402d-82fb-b79e4328f524 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:08.588304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=7 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:08.589073 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=23 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:08.593802 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c6cd988e-06e3-402d-82fb-b79e4328f524 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:08.594258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c6cd988e-06e3-402d-82fb-b79e4328f524 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:08.595027 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c6cd988e-06e3-402d-82fb-b79e4328f524 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:08.595471 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c6cd988e-06e3-402d-82fb-b79e4328f524 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:08.618647 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c6cd988e-06e3-402d-82fb-b79e4328f524 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/ips" status: 200 len: 145 microversion: 2.1 time: 0.037630 Jul 20 17:58:08.619218 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 492/972] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 17:58:08 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:58:11.626709 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=3 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:11.627474 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=7 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:11.632011 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3a217857-e5d1-47f9-a44b-8ba4200c6e7f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c4a0a86-349b-44a2-adc2-4cab9341c82b"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:58:11.633270 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3a217857-e5d1-47f9-a44b-8ba4200c6e7f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:11.639289 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a217857-e5d1-47f9-a44b-8ba4200c6e7f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:11.639736 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a217857-e5d1-47f9-a44b-8ba4200c6e7f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:11.640531 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a217857-e5d1-47f9-a44b-8ba4200c6e7f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:11.640971 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a217857-e5d1-47f9-a44b-8ba4200c6e7f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:12.976281 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3a217857-e5d1-47f9-a44b-8ba4200c6e7f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.351070 Jul 20 17:58:12.977352 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 481/973] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 17:58:11 2022] POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/os-volume_attachments => generated 194 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:58:13.436490 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4162c5a6-de12-4b06-ad87-bc81a7e30842 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:58:13.437248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4162c5a6-de12-4b06-ad87-bc81a7e30842 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:13.445190 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4162c5a6-de12-4b06-ad87-bc81a7e30842 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:13.445634 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4162c5a6-de12-4b06-ad87-bc81a7e30842 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:13.446429 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4162c5a6-de12-4b06-ad87-bc81a7e30842 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:13.446821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4162c5a6-de12-4b06-ad87-bc81a7e30842 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:13.472149 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-4162c5a6-de12-4b06-ad87-bc81a7e30842 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lazy-loading 'flavor' on Instance uuid 940b1e17-6334-434f-a6f4-ea98310e44f9 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:58:13.846784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4162c5a6-de12-4b06-ad87-bc81a7e30842 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "POST /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9/action" status: 202 len: 0 microversion: 2.1 time: 0.413164 Jul 20 17:58:13.846784 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 493/974] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:58:13 2022] POST /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:58:13.857266 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-64879021-c027-44d2-8f7c-754ea48ed629 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:13.857966 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-64879021-c027-44d2-8f7c-754ea48ed629 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:13.865328 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64879021-c027-44d2-8f7c-754ea48ed629 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:13.865813 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64879021-c027-44d2-8f7c-754ea48ed629 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:13.866583 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64879021-c027-44d2-8f7c-754ea48ed629 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:13.867268 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-64879021-c027-44d2-8f7c-754ea48ed629 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:14.000164 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-64879021-c027-44d2-8f7c-754ea48ed629 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:14.008393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-64879021-c027-44d2-8f7c-754ea48ed629 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.157321 Jul 20 17:58:14.009177 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 482/975] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:13 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:15.026375 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7696021f-f779-41e4-91f8-efa469a06a01 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:15.027093 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7696021f-f779-41e4-91f8-efa469a06a01 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:15.033255 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7696021f-f779-41e4-91f8-efa469a06a01 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:15.033698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7696021f-f779-41e4-91f8-efa469a06a01 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:15.034445 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7696021f-f779-41e4-91f8-efa469a06a01 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:15.034872 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7696021f-f779-41e4-91f8-efa469a06a01 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:15.185719 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7696021f-f779-41e4-91f8-efa469a06a01 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:15.194065 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7696021f-f779-41e4-91f8-efa469a06a01 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.172072 Jul 20 17:58:15.194637 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 494/976] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:15 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:16.211713 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f2639f13-f5f6-4723-bdb9-3e49c905eaf3 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:16.212333 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f2639f13-f5f6-4723-bdb9-3e49c905eaf3 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:16.218859 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2639f13-f5f6-4723-bdb9-3e49c905eaf3 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:16.219307 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2639f13-f5f6-4723-bdb9-3e49c905eaf3 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:16.220066 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2639f13-f5f6-4723-bdb9-3e49c905eaf3 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:16.220526 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2639f13-f5f6-4723-bdb9-3e49c905eaf3 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:16.361329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f2639f13-f5f6-4723-bdb9-3e49c905eaf3 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:16.369063 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f2639f13-f5f6-4723-bdb9-3e49c905eaf3 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.161816 Jul 20 17:58:16.369624 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 483/977] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:16 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:17.386009 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-493113d5-735a-48ad-8d43-79cf1f1bc2cd tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:17.386625 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-493113d5-735a-48ad-8d43-79cf1f1bc2cd tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:17.393150 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-493113d5-735a-48ad-8d43-79cf1f1bc2cd tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:17.393601 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-493113d5-735a-48ad-8d43-79cf1f1bc2cd tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:17.394359 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-493113d5-735a-48ad-8d43-79cf1f1bc2cd tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:17.394797 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-493113d5-735a-48ad-8d43-79cf1f1bc2cd tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:17.528009 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-493113d5-735a-48ad-8d43-79cf1f1bc2cd tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:17.536420 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-493113d5-735a-48ad-8d43-79cf1f1bc2cd tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.154280 Jul 20 17:58:17.537016 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 495/978] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:17 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:58:18.553453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-951125cb-793d-4709-9828-69cbefcde364 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:18.554058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-951125cb-793d-4709-9828-69cbefcde364 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:18.560872 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-951125cb-793d-4709-9828-69cbefcde364 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:18.561366 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-951125cb-793d-4709-9828-69cbefcde364 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:18.562132 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-951125cb-793d-4709-9828-69cbefcde364 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:18.562564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-951125cb-793d-4709-9828-69cbefcde364 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:18.693181 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-951125cb-793d-4709-9828-69cbefcde364 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:18.708147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-951125cb-793d-4709-9828-69cbefcde364 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.154042 Jul 20 17:58:18.708147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 484/979] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:18 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:19.722514 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-3e6b6714-7c97-4ca3-bb82-fadd2bde5768 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:19.723145 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-3e6b6714-7c97-4ca3-bb82-fadd2bde5768 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:19.729796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e6b6714-7c97-4ca3-bb82-fadd2bde5768 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:19.730237 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e6b6714-7c97-4ca3-bb82-fadd2bde5768 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:19.730981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e6b6714-7c97-4ca3-bb82-fadd2bde5768 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:19.731408 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-3e6b6714-7c97-4ca3-bb82-fadd2bde5768 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:19.872549 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-3e6b6714-7c97-4ca3-bb82-fadd2bde5768 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:19.880149 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-3e6b6714-7c97-4ca3-bb82-fadd2bde5768 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.161498 Jul 20 17:58:19.880786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 496/980] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:19 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:20.897289 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7d9aa340-3446-4a64-a2a1-feb1dbfd69ea tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:20.897908 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7d9aa340-3446-4a64-a2a1-feb1dbfd69ea tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:20.904721 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7d9aa340-3446-4a64-a2a1-feb1dbfd69ea tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:20.905238 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7d9aa340-3446-4a64-a2a1-feb1dbfd69ea tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:20.906067 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7d9aa340-3446-4a64-a2a1-feb1dbfd69ea tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:20.906505 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7d9aa340-3446-4a64-a2a1-feb1dbfd69ea tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:21.043737 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7d9aa340-3446-4a64-a2a1-feb1dbfd69ea tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:21.051345 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7d9aa340-3446-4a64-a2a1-feb1dbfd69ea tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.157959 Jul 20 17:58:21.051923 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 485/981] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:20 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:21.548517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-37e238f3-e86f-4005-8797-c0cb50270313 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:58:21.555605 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-37e238f3-e86f-4005-8797-c0cb50270313 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:21.556050 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-37e238f3-e86f-4005-8797-c0cb50270313 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:21.615845 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-37e238f3-e86f-4005-8797-c0cb50270313 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Going to try to stop instance {{(pid=124846) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 17:58:21.838815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-37e238f3-e86f-4005-8797-c0cb50270313 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/action" status: 202 len: 0 microversion: 2.1 time: 0.293886 Jul 20 17:58:21.839554 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 497/982] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:58:21 2022] POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:58:21.847712 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-29cc3078-5e92-40dd-9399-fe41bd8976b8 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:21.848376 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-29cc3078-5e92-40dd-9399-fe41bd8976b8 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:21.854413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-29cc3078-5e92-40dd-9399-fe41bd8976b8 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:21.854863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-29cc3078-5e92-40dd-9399-fe41bd8976b8 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:21.855628 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-29cc3078-5e92-40dd-9399-fe41bd8976b8 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:21.856065 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-29cc3078-5e92-40dd-9399-fe41bd8976b8 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:21.986408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-29cc3078-5e92-40dd-9399-fe41bd8976b8 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:21.996561 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-29cc3078-5e92-40dd-9399-fe41bd8976b8 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.152640 Jul 20 17:58:21.997200 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 486/983] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:21 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:22.076044 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5e80b9f2-039b-4e07-b579-f4f6e6a6858c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:22.076990 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5e80b9f2-039b-4e07-b579-f4f6e6a6858c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:22.083703 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e80b9f2-039b-4e07-b579-f4f6e6a6858c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:22.084142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e80b9f2-039b-4e07-b579-f4f6e6a6858c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:22.085059 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e80b9f2-039b-4e07-b579-f4f6e6a6858c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:22.085491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5e80b9f2-039b-4e07-b579-f4f6e6a6858c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:22.225365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5e80b9f2-039b-4e07-b579-f4f6e6a6858c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:22.232946 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5e80b9f2-039b-4e07-b579-f4f6e6a6858c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.161274 Jul 20 17:58:22.239287 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 498/984] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:22 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:23.013841 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f91ae586-12de-43c0-80bc-ac6e3940bbcf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:23.014457 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f91ae586-12de-43c0-80bc-ac6e3940bbcf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:23.021932 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f91ae586-12de-43c0-80bc-ac6e3940bbcf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:23.022384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f91ae586-12de-43c0-80bc-ac6e3940bbcf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:23.023149 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f91ae586-12de-43c0-80bc-ac6e3940bbcf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:23.023589 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f91ae586-12de-43c0-80bc-ac6e3940bbcf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:23.154913 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f91ae586-12de-43c0-80bc-ac6e3940bbcf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:23.163086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f91ae586-12de-43c0-80bc-ac6e3940bbcf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.153196 Jul 20 17:58:23.163655 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 487/985] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:23 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:23.250202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4f5ddb8c-9dba-4f66-adc3-5bdc37a169da tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:23.250815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4f5ddb8c-9dba-4f66-adc3-5bdc37a169da tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:23.257294 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4f5ddb8c-9dba-4f66-adc3-5bdc37a169da tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:23.257745 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4f5ddb8c-9dba-4f66-adc3-5bdc37a169da tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:23.258710 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4f5ddb8c-9dba-4f66-adc3-5bdc37a169da tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:23.259134 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4f5ddb8c-9dba-4f66-adc3-5bdc37a169da tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:23.392616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4f5ddb8c-9dba-4f66-adc3-5bdc37a169da tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:23.401357 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4f5ddb8c-9dba-4f66-adc3-5bdc37a169da tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.155013 Jul 20 17:58:23.402008 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 499/986] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:23 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:24.180805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-baa432a1-5b93-4b4b-9254-529314203f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:24.181448 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-baa432a1-5b93-4b4b-9254-529314203f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:24.188032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baa432a1-5b93-4b4b-9254-529314203f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:24.188526 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baa432a1-5b93-4b4b-9254-529314203f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:24.189297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baa432a1-5b93-4b4b-9254-529314203f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:24.189737 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-baa432a1-5b93-4b4b-9254-529314203f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:24.320453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-baa432a1-5b93-4b4b-9254-529314203f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:24.328371 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-baa432a1-5b93-4b4b-9254-529314203f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.152131 Jul 20 17:58:24.328967 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 488/987] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:24 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:24.418780 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6394f894-1aca-4b5c-ae6f-0f7a2cd2d418 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:24.419405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6394f894-1aca-4b5c-ae6f-0f7a2cd2d418 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:24.425864 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6394f894-1aca-4b5c-ae6f-0f7a2cd2d418 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:24.427260 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6394f894-1aca-4b5c-ae6f-0f7a2cd2d418 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:24.427611 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6394f894-1aca-4b5c-ae6f-0f7a2cd2d418 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:24.428047 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6394f894-1aca-4b5c-ae6f-0f7a2cd2d418 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:24.566997 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6394f894-1aca-4b5c-ae6f-0f7a2cd2d418 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:24.575504 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6394f894-1aca-4b5c-ae6f-0f7a2cd2d418 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.160720 Jul 20 17:58:24.576354 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 500/988] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:24 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:25.345247 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-113e7e31-0f58-4f66-8245-b2937ab1862b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:25.347376 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-113e7e31-0f58-4f66-8245-b2937ab1862b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:25.352057 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-113e7e31-0f58-4f66-8245-b2937ab1862b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:25.352531 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-113e7e31-0f58-4f66-8245-b2937ab1862b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:25.353297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-113e7e31-0f58-4f66-8245-b2937ab1862b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:25.353731 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-113e7e31-0f58-4f66-8245-b2937ab1862b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:25.503819 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-113e7e31-0f58-4f66-8245-b2937ab1862b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:25.511739 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-113e7e31-0f58-4f66-8245-b2937ab1862b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.170368 Jul 20 17:58:25.512240 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 489/989] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:25 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:25.594221 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-696f9768-4de0-481d-b003-90a13c4ea111 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:25.596307 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-696f9768-4de0-481d-b003-90a13c4ea111 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:25.603869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-696f9768-4de0-481d-b003-90a13c4ea111 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:25.604319 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-696f9768-4de0-481d-b003-90a13c4ea111 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:25.605307 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-696f9768-4de0-481d-b003-90a13c4ea111 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:25.605740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-696f9768-4de0-481d-b003-90a13c4ea111 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:25.765494 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-696f9768-4de0-481d-b003-90a13c4ea111 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:25.769594 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-696f9768-4de0-481d-b003-90a13c4ea111 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.179852 Jul 20 17:58:25.770245 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 501/990] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:25 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:26.529092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-75693e7c-6fa4-4d26-91f7-fa9e1f2cb00d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:26.529744 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-75693e7c-6fa4-4d26-91f7-fa9e1f2cb00d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:26.536159 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-75693e7c-6fa4-4d26-91f7-fa9e1f2cb00d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:26.536662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-75693e7c-6fa4-4d26-91f7-fa9e1f2cb00d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:26.537430 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-75693e7c-6fa4-4d26-91f7-fa9e1f2cb00d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:26.537869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-75693e7c-6fa4-4d26-91f7-fa9e1f2cb00d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:26.721269 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-75693e7c-6fa4-4d26-91f7-fa9e1f2cb00d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:26.731251 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-75693e7c-6fa4-4d26-91f7-fa9e1f2cb00d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.206071 Jul 20 17:58:26.731866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 490/991] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:26 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:58:26.786940 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-04b3bd61-6607-491e-b06b-008281638b8a tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:26.787555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-04b3bd61-6607-491e-b06b-008281638b8a tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:26.794064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-04b3bd61-6607-491e-b06b-008281638b8a tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:26.794511 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-04b3bd61-6607-491e-b06b-008281638b8a tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:26.795275 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-04b3bd61-6607-491e-b06b-008281638b8a tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:26.795709 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-04b3bd61-6607-491e-b06b-008281638b8a tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:26.925620 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-04b3bd61-6607-491e-b06b-008281638b8a tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:26.933547 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-04b3bd61-6607-491e-b06b-008281638b8a tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.151276 Jul 20 17:58:26.934115 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 502/992] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:26 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:27.748355 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2d21edd7-cfe0-4c0f-aeb1-e1262908933b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:27.749046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2d21edd7-cfe0-4c0f-aeb1-e1262908933b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:27.755980 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d21edd7-cfe0-4c0f-aeb1-e1262908933b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:27.756426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d21edd7-cfe0-4c0f-aeb1-e1262908933b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:27.757240 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d21edd7-cfe0-4c0f-aeb1-e1262908933b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:27.757695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2d21edd7-cfe0-4c0f-aeb1-e1262908933b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:27.888794 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2d21edd7-cfe0-4c0f-aeb1-e1262908933b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:27.897116 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2d21edd7-cfe0-4c0f-aeb1-e1262908933b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.152720 Jul 20 17:58:27.897676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 491/993] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:27 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:27.953287 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-01f3e517-c851-4938-9d8b-95eee1d6d8f8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:27.953825 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-01f3e517-c851-4938-9d8b-95eee1d6d8f8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:27.961035 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-01f3e517-c851-4938-9d8b-95eee1d6d8f8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:27.961479 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-01f3e517-c851-4938-9d8b-95eee1d6d8f8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:27.962225 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-01f3e517-c851-4938-9d8b-95eee1d6d8f8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:27.962651 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-01f3e517-c851-4938-9d8b-95eee1d6d8f8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:28.113974 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-01f3e517-c851-4938-9d8b-95eee1d6d8f8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:28.121522 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-01f3e517-c851-4938-9d8b-95eee1d6d8f8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.172085 Jul 20 17:58:28.122097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 503/994] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:27 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:28.914085 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a3a5a437-50e4-4bee-bad6-3a2c59375cd5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:28.914728 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a3a5a437-50e4-4bee-bad6-3a2c59375cd5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:28.922226 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a3a5a437-50e4-4bee-bad6-3a2c59375cd5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:28.922708 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a3a5a437-50e4-4bee-bad6-3a2c59375cd5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:28.923481 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a3a5a437-50e4-4bee-bad6-3a2c59375cd5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:28.923921 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a3a5a437-50e4-4bee-bad6-3a2c59375cd5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:29.065437 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a3a5a437-50e4-4bee-bad6-3a2c59375cd5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:29.074273 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a3a5a437-50e4-4bee-bad6-3a2c59375cd5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.164184 Jul 20 17:58:29.074837 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 492/995] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:28 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:29.139194 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5d2aae12-3474-4559-847a-fc0e1e40f86d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:29.139916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5d2aae12-3474-4559-847a-fc0e1e40f86d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:29.146634 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5d2aae12-3474-4559-847a-fc0e1e40f86d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:29.147083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5d2aae12-3474-4559-847a-fc0e1e40f86d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:29.147845 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5d2aae12-3474-4559-847a-fc0e1e40f86d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:29.148279 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5d2aae12-3474-4559-847a-fc0e1e40f86d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:29.277239 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5d2aae12-3474-4559-847a-fc0e1e40f86d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:29.284735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5d2aae12-3474-4559-847a-fc0e1e40f86d tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1509 microversion: 2.1 time: 0.149323 Jul 20 17:58:29.285971 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 504/996] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:29 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:29.302506 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-685ee2a0-6f48-4032-993e-a4b6c8b44c36 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:58:29.303080 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-685ee2a0-6f48-4032-993e-a4b6c8b44c36 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:29.309166 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-685ee2a0-6f48-4032-993e-a4b6c8b44c36 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:29.309623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-685ee2a0-6f48-4032-993e-a4b6c8b44c36 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:29.310386 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-685ee2a0-6f48-4032-993e-a4b6c8b44c36 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:29.310826 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-685ee2a0-6f48-4032-993e-a4b6c8b44c36 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:29.609034 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-685ee2a0-6f48-4032-993e-a4b6c8b44c36 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "POST /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9/action" status: 202 len: 0 microversion: 2.1 time: 0.310992 Jul 20 17:58:29.610195 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 493/997] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:58:29 2022] POST /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:58:29.618428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-dfe5ee2f-9150-4f83-9381-39e84a06bfce tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:29.619306 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-dfe5ee2f-9150-4f83-9381-39e84a06bfce tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:29.625878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dfe5ee2f-9150-4f83-9381-39e84a06bfce tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:29.626327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dfe5ee2f-9150-4f83-9381-39e84a06bfce tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:29.627283 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dfe5ee2f-9150-4f83-9381-39e84a06bfce tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:29.627878 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dfe5ee2f-9150-4f83-9381-39e84a06bfce tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:29.764995 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-dfe5ee2f-9150-4f83-9381-39e84a06bfce tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:29.773358 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:29.779782 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-dfe5ee2f-9150-4f83-9381-39e84a06bfce tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1517 microversion: 2.1 time: 0.165221 Jul 20 17:58:29.782308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 505/998] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:29 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:30.091485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-08f6fd4b-c342-4a7a-8bd1-9fab42e32c5c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:30.092132 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-08f6fd4b-c342-4a7a-8bd1-9fab42e32c5c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:30.099128 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08f6fd4b-c342-4a7a-8bd1-9fab42e32c5c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:30.099671 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08f6fd4b-c342-4a7a-8bd1-9fab42e32c5c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:30.100475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08f6fd4b-c342-4a7a-8bd1-9fab42e32c5c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:30.101691 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-08f6fd4b-c342-4a7a-8bd1-9fab42e32c5c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:30.235838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-08f6fd4b-c342-4a7a-8bd1-9fab42e32c5c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:30.243778 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-08f6fd4b-c342-4a7a-8bd1-9fab42e32c5c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.156647 Jul 20 17:58:30.244388 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 494/999] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:30 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:30.483722 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-00fb4ea1-7d76-4554-8f94-eab55e13b864 req-831cfef1-3f39-4a1d-9ce1-716fb7d1efce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940b1e17-6334-434f-a6f4-ea98310e44f9", "name": "network-vif-unplugged", "status": "completed", "tag": "0d2efd3e-013a-4a3b-bc60-84e6553804e3"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:58:30.501969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-00fb4ea1-7d76-4554-8f94-eab55e13b864 req-831cfef1-3f39-4a1d-9ce1-716fb7d1efce service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:30.501969 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-00fb4ea1-7d76-4554-8f94-eab55e13b864 req-831cfef1-3f39-4a1d-9ce1-716fb7d1efce service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:30.513212 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.compute.server_external_events [req-00fb4ea1-7d76-4554-8f94-eab55e13b864 req-831cfef1-3f39-4a1d-9ce1-716fb7d1efce service nova] Unable to find a host for instance 940b1e17-6334-434f-a6f4-ea98310e44f9. Dropping event network-vif-unplugged {{(pid=124846) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 17:58:30.514034 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-00fb4ea1-7d76-4554-8f94-eab55e13b864 req-831cfef1-3f39-4a1d-9ce1-716fb7d1efce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035309 Jul 20 17:58:30.514622 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 506/1000] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 17:58:30.799172 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-738bc8d0-ad47-44a2-89ef-ea6ad0e7faf4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:30.799700 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-738bc8d0-ad47-44a2-89ef-ea6ad0e7faf4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:30.805912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-738bc8d0-ad47-44a2-89ef-ea6ad0e7faf4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:30.806404 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-738bc8d0-ad47-44a2-89ef-ea6ad0e7faf4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:30.807160 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-738bc8d0-ad47-44a2-89ef-ea6ad0e7faf4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:30.807592 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-738bc8d0-ad47-44a2-89ef-ea6ad0e7faf4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:30.811679 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:30.942553 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-738bc8d0-ad47-44a2-89ef-ea6ad0e7faf4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:30.960898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-738bc8d0-ad47-44a2-89ef-ea6ad0e7faf4 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1517 microversion: 2.1 time: 0.154959 Jul 20 17:58:30.960898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 495/1001] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:30 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:58:31.261866 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-19770cb9-b4bb-4662-9dc9-717af0d5b8e4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:31.262490 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-19770cb9-b4bb-4662-9dc9-717af0d5b8e4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:31.268739 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-19770cb9-b4bb-4662-9dc9-717af0d5b8e4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:31.269181 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-19770cb9-b4bb-4662-9dc9-717af0d5b8e4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:31.270420 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-19770cb9-b4bb-4662-9dc9-717af0d5b8e4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:31.270846 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-19770cb9-b4bb-4662-9dc9-717af0d5b8e4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:31.409966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-19770cb9-b4bb-4662-9dc9-717af0d5b8e4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:31.418852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-19770cb9-b4bb-4662-9dc9-717af0d5b8e4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.160962 Jul 20 17:58:31.419463 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 507/1002] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:31 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:31.968080 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-80f08349-a84d-47d2-b937-7ff3a7aff2c5 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:31.968667 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-80f08349-a84d-47d2-b937-7ff3a7aff2c5 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:31.976520 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-80f08349-a84d-47d2-b937-7ff3a7aff2c5 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:31.976975 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-80f08349-a84d-47d2-b937-7ff3a7aff2c5 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:31.977742 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-80f08349-a84d-47d2-b937-7ff3a7aff2c5 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:31.978183 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-80f08349-a84d-47d2-b937-7ff3a7aff2c5 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:32.106762 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-80f08349-a84d-47d2-b937-7ff3a7aff2c5 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:32.114261 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-80f08349-a84d-47d2-b937-7ff3a7aff2c5 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1519 microversion: 2.1 time: 0.150178 Jul 20 17:58:32.114826 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 496/1003] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:31 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:32.435044 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6f70a3ba-a5c8-4403-ac10-222fb4943d0f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:32.435655 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6f70a3ba-a5c8-4403-ac10-222fb4943d0f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:32.442372 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6f70a3ba-a5c8-4403-ac10-222fb4943d0f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:32.447197 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6f70a3ba-a5c8-4403-ac10-222fb4943d0f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:32.447197 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6f70a3ba-a5c8-4403-ac10-222fb4943d0f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:32.447197 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6f70a3ba-a5c8-4403-ac10-222fb4943d0f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:32.575603 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6f70a3ba-a5c8-4403-ac10-222fb4943d0f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:32.583956 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6f70a3ba-a5c8-4403-ac10-222fb4943d0f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.152785 Jul 20 17:58:32.584552 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 508/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:32 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:33.131911 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e8add492-4add-459c-a413-4122836a694f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:33.133131 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e8add492-4add-459c-a413-4122836a694f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:33.140094 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e8add492-4add-459c-a413-4122836a694f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:33.140665 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e8add492-4add-459c-a413-4122836a694f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:33.146444 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e8add492-4add-459c-a413-4122836a694f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:33.146444 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e8add492-4add-459c-a413-4122836a694f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:33.277358 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e8add492-4add-459c-a413-4122836a694f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:33.284944 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e8add492-4add-459c-a413-4122836a694f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1519 microversion: 2.1 time: 0.157554 Jul 20 17:58:33.286047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 497/1005] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:33 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:33.601823 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6cfb3f80-aa31-4c31-981e-57a672d9d353 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:33.602343 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6cfb3f80-aa31-4c31-981e-57a672d9d353 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:33.608807 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6cfb3f80-aa31-4c31-981e-57a672d9d353 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:33.609250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6cfb3f80-aa31-4c31-981e-57a672d9d353 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:33.609997 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6cfb3f80-aa31-4c31-981e-57a672d9d353 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:33.610423 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6cfb3f80-aa31-4c31-981e-57a672d9d353 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:33.745463 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6cfb3f80-aa31-4c31-981e-57a672d9d353 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:33.754029 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6cfb3f80-aa31-4c31-981e-57a672d9d353 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.156732 Jul 20 17:58:33.754655 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 509/1006] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:33 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:34.302691 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4f4a5f1f-dd47-4640-a039-7e74b895b78f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:34.303782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4f4a5f1f-dd47-4640-a039-7e74b895b78f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:34.309955 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f4a5f1f-dd47-4640-a039-7e74b895b78f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:34.310406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f4a5f1f-dd47-4640-a039-7e74b895b78f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:34.311184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f4a5f1f-dd47-4640-a039-7e74b895b78f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:34.311624 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4f4a5f1f-dd47-4640-a039-7e74b895b78f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:34.451496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4f4a5f1f-dd47-4640-a039-7e74b895b78f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:34.466802 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4f4a5f1f-dd47-4640-a039-7e74b895b78f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1575 microversion: 2.1 time: 0.168348 Jul 20 17:58:34.467391 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 498/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:34 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:34.772389 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b20e9856-3db5-493f-a06c-31cbb1720c88 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:34.773136 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b20e9856-3db5-493f-a06c-31cbb1720c88 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:34.779699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b20e9856-3db5-493f-a06c-31cbb1720c88 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:34.780147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b20e9856-3db5-493f-a06c-31cbb1720c88 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:34.780934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b20e9856-3db5-493f-a06c-31cbb1720c88 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:34.781394 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b20e9856-3db5-493f-a06c-31cbb1720c88 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:34.917658 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b20e9856-3db5-493f-a06c-31cbb1720c88 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:34.925659 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b20e9856-3db5-493f-a06c-31cbb1720c88 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.158469 Jul 20 17:58:34.926732 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 510/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:34 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:35.484582 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-816f5045-5a21-4ada-b165-42c4a3e5fa69 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:35.485111 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-816f5045-5a21-4ada-b165-42c4a3e5fa69 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:35.492021 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-816f5045-5a21-4ada-b165-42c4a3e5fa69 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:35.492501 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-816f5045-5a21-4ada-b165-42c4a3e5fa69 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:35.493273 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-816f5045-5a21-4ada-b165-42c4a3e5fa69 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:35.493715 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-816f5045-5a21-4ada-b165-42c4a3e5fa69 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:35.631369 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-816f5045-5a21-4ada-b165-42c4a3e5fa69 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:35.639262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-816f5045-5a21-4ada-b165-42c4a3e5fa69 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1575 microversion: 2.1 time: 0.158633 Jul 20 17:58:35.639837 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 499/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:35 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:35.943710 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ec8acec6-3138-4399-b62a-f57794ebc1d6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:35.944604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ec8acec6-3138-4399-b62a-f57794ebc1d6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:35.951053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ec8acec6-3138-4399-b62a-f57794ebc1d6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:35.951570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ec8acec6-3138-4399-b62a-f57794ebc1d6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:35.952399 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ec8acec6-3138-4399-b62a-f57794ebc1d6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:35.952855 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ec8acec6-3138-4399-b62a-f57794ebc1d6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:36.083664 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ec8acec6-3138-4399-b62a-f57794ebc1d6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:36.092804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ec8acec6-3138-4399-b62a-f57794ebc1d6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.153609 Jul 20 17:58:36.094324 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 511/1010] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:35 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:36.656453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4306d9dc-761b-417a-9752-db5c98414916 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:36.657223 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4306d9dc-761b-417a-9752-db5c98414916 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:36.663774 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4306d9dc-761b-417a-9752-db5c98414916 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:36.664297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4306d9dc-761b-417a-9752-db5c98414916 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:36.665156 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4306d9dc-761b-417a-9752-db5c98414916 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:36.665706 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4306d9dc-761b-417a-9752-db5c98414916 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:36.798275 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4306d9dc-761b-417a-9752-db5c98414916 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:36.805907 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4306d9dc-761b-417a-9752-db5c98414916 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1575 microversion: 2.1 time: 0.153466 Jul 20 17:58:36.806466 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 500/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:36 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:37.111433 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-24ad9eb5-151d-48e3-b37d-94d6010d589f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:37.112050 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-24ad9eb5-151d-48e3-b37d-94d6010d589f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:37.119632 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-24ad9eb5-151d-48e3-b37d-94d6010d589f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:37.121228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-24ad9eb5-151d-48e3-b37d-94d6010d589f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:37.121228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-24ad9eb5-151d-48e3-b37d-94d6010d589f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:37.121546 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-24ad9eb5-151d-48e3-b37d-94d6010d589f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:37.256249 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-24ad9eb5-151d-48e3-b37d-94d6010d589f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:37.264843 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-24ad9eb5-151d-48e3-b37d-94d6010d589f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1723 microversion: 2.1 time: 0.157223 Jul 20 17:58:37.265442 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 512/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:37 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:37.823052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-da6d9aa9-fb13-4d68-b105-b6e51e50be9f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:37.823662 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-da6d9aa9-fb13-4d68-b105-b6e51e50be9f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:37.830419 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da6d9aa9-fb13-4d68-b105-b6e51e50be9f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:37.830875 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da6d9aa9-fb13-4d68-b105-b6e51e50be9f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:37.831663 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da6d9aa9-fb13-4d68-b105-b6e51e50be9f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:37.832677 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-da6d9aa9-fb13-4d68-b105-b6e51e50be9f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:37.961081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-da6d9aa9-fb13-4d68-b105-b6e51e50be9f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:37.968457 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-da6d9aa9-fb13-4d68-b105-b6e51e50be9f tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1575 microversion: 2.1 time: 0.149510 Jul 20 17:58:37.969012 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 501/1013] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:37 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:38.282223 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d401f78f-d1fb-4a4a-90ba-5921c766dbde tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:38.282739 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d401f78f-d1fb-4a4a-90ba-5921c766dbde tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:38.289200 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d401f78f-d1fb-4a4a-90ba-5921c766dbde tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:38.289652 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d401f78f-d1fb-4a4a-90ba-5921c766dbde tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:38.290419 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d401f78f-d1fb-4a4a-90ba-5921c766dbde tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:38.290855 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d401f78f-d1fb-4a4a-90ba-5921c766dbde tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:38.565313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-0781a199-8a59-43fb-9530-2251844594f2 req-73c5d405-01af-451b-a9ec-54cfb7d73c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940b1e17-6334-434f-a6f4-ea98310e44f9", "name": "network-vif-plugged", "status": "completed", "tag": "0d2efd3e-013a-4a3b-bc60-84e6553804e3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:58:38.575623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0781a199-8a59-43fb-9530-2251844594f2 req-73c5d405-01af-451b-a9ec-54cfb7d73c6a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:38.576074 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-0781a199-8a59-43fb-9530-2251844594f2 req-73c5d405-01af-451b-a9ec-54cfb7d73c6a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:38.588621 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-0781a199-8a59-43fb-9530-2251844594f2 req-73c5d405-01af-451b-a9ec-54cfb7d73c6a service nova] Creating event network-vif-plugged:0d2efd3e-013a-4a3b-bc60-84e6553804e3 for instance 940b1e17-6334-434f-a6f4-ea98310e44f9 on hv-cinder-84984 Jul 20 17:58:38.593846 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-0781a199-8a59-43fb-9530-2251844594f2 req-73c5d405-01af-451b-a9ec-54cfb7d73c6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 Jul 20 17:58:38.594610 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 502/1014] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:58:38.668541 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d401f78f-d1fb-4a4a-90ba-5921c766dbde tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:38.677107 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d401f78f-d1fb-4a4a-90ba-5921c766dbde tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1700 microversion: 2.1 time: 0.398916 Jul 20 17:58:38.677684 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 513/1015] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:38 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1700 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:38.694576 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3c9c1915-2882-4864-b300-282f81699b9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:58:38.700947 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c9c1915-2882-4864-b300-282f81699b9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:38.701411 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3c9c1915-2882-4864-b300-282f81699b9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:38.761148 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3c9c1915-2882-4864-b300-282f81699b9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Going to try to start instance {{(pid=124845) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 17:58:38.985217 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9c3a5507-5a98-4138-8022-f80161fadc20 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:38.985839 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9c3a5507-5a98-4138-8022-f80161fadc20 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:38.991900 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9c3a5507-5a98-4138-8022-f80161fadc20 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:38.992355 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9c3a5507-5a98-4138-8022-f80161fadc20 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:38.993154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9c3a5507-5a98-4138-8022-f80161fadc20 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:38.993593 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9c3a5507-5a98-4138-8022-f80161fadc20 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:39.049318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3c9c1915-2882-4864-b300-282f81699b9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/action" status: 202 len: 0 microversion: 2.1 time: 0.359352 Jul 20 17:58:39.053405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 503/1016] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:58:38 2022] POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:58:39.068695 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-69ae8ed7-80b9-4c11-840d-d1874c4d8887 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:39.070400 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-69ae8ed7-80b9-4c11-840d-d1874c4d8887 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:39.078058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69ae8ed7-80b9-4c11-840d-d1874c4d8887 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:39.078796 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69ae8ed7-80b9-4c11-840d-d1874c4d8887 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:39.079959 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69ae8ed7-80b9-4c11-840d-d1874c4d8887 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:39.080813 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-69ae8ed7-80b9-4c11-840d-d1874c4d8887 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:39.168405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9c3a5507-5a98-4138-8022-f80161fadc20 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:39.176026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9c3a5507-5a98-4138-8022-f80161fadc20 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1575 microversion: 2.1 time: 0.194712 Jul 20 17:58:39.176621 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 514/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:38 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:58:39.235382 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-69ae8ed7-80b9-4c11-840d-d1874c4d8887 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:39.243482 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-69ae8ed7-80b9-4c11-840d-d1874c4d8887 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1709 microversion: 2.1 time: 0.188572 Jul 20 17:58:39.244044 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 504/1018] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:39 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1709 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:40.193265 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a721cb18-fce0-4d8d-9b7b-65dfb13ece4c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:40.194198 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a721cb18-fce0-4d8d-9b7b-65dfb13ece4c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:40.201140 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a721cb18-fce0-4d8d-9b7b-65dfb13ece4c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:40.201591 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a721cb18-fce0-4d8d-9b7b-65dfb13ece4c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:40.202480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a721cb18-fce0-4d8d-9b7b-65dfb13ece4c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:40.202820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a721cb18-fce0-4d8d-9b7b-65dfb13ece4c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:40.260420 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-9dc80dd5-8003-44d0-9b63-2fed4ebfc129 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:40.261054 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-9dc80dd5-8003-44d0-9b63-2fed4ebfc129 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:40.267550 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9dc80dd5-8003-44d0-9b63-2fed4ebfc129 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:40.268003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9dc80dd5-8003-44d0-9b63-2fed4ebfc129 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:40.268832 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9dc80dd5-8003-44d0-9b63-2fed4ebfc129 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:40.269910 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-9dc80dd5-8003-44d0-9b63-2fed4ebfc129 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:40.380115 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a721cb18-fce0-4d8d-9b7b-65dfb13ece4c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:40.386281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a721cb18-fce0-4d8d-9b7b-65dfb13ece4c tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1575 microversion: 2.1 time: 0.196912 Jul 20 17:58:40.386862 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 515/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:40 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:58:40.426040 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-9dc80dd5-8003-44d0-9b63-2fed4ebfc129 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:40.434022 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-9dc80dd5-8003-44d0-9b63-2fed4ebfc129 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1709 microversion: 2.1 time: 0.177433 Jul 20 17:58:40.434589 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 505/1020] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:40 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:58:41.403626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-67c7608d-b486-4aa6-a9aa-c7abceb27e02 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:41.404241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-67c7608d-b486-4aa6-a9aa-c7abceb27e02 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:41.411036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-67c7608d-b486-4aa6-a9aa-c7abceb27e02 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:41.411485 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-67c7608d-b486-4aa6-a9aa-c7abceb27e02 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:41.412278 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-67c7608d-b486-4aa6-a9aa-c7abceb27e02 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:41.412738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-67c7608d-b486-4aa6-a9aa-c7abceb27e02 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:41.451688 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-94de4e2b-bf05-41ba-84df-b69a28d569bd tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:41.452470 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-94de4e2b-bf05-41ba-84df-b69a28d569bd tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:41.463459 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94de4e2b-bf05-41ba-84df-b69a28d569bd tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:41.464265 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94de4e2b-bf05-41ba-84df-b69a28d569bd tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:41.465168 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94de4e2b-bf05-41ba-84df-b69a28d569bd tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:41.465677 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-94de4e2b-bf05-41ba-84df-b69a28d569bd tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:41.612035 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-67c7608d-b486-4aa6-a9aa-c7abceb27e02 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:41.620508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-67c7608d-b486-4aa6-a9aa-c7abceb27e02 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1562 microversion: 2.1 time: 0.221233 Jul 20 17:58:41.621081 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 516/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:41 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:58:41.633531 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-94de4e2b-bf05-41ba-84df-b69a28d569bd tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:41.642496 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-94de4e2b-bf05-41ba-84df-b69a28d569bd tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1709 microversion: 2.1 time: 0.194026 Jul 20 17:58:41.643102 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 506/1022] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:41 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1709 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:58:42.659249 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4a4a4aca-f9f1-4ec3-b6dc-d15af1fcf99f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:58:42.660599 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4a4a4aca-f9f1-4ec3-b6dc-d15af1fcf99f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:58:42.666399 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4a4a4aca-f9f1-4ec3-b6dc-d15af1fcf99f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:42.666843 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4a4a4aca-f9f1-4ec3-b6dc-d15af1fcf99f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:42.667624 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4a4a4aca-f9f1-4ec3-b6dc-d15af1fcf99f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:58:42.668055 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4a4a4aca-f9f1-4ec3-b6dc-d15af1fcf99f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:58:42.803307 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4a4a4aca-f9f1-4ec3-b6dc-d15af1fcf99f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:58:42.811315 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4a4a4aca-f9f1-4ec3-b6dc-d15af1fcf99f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1713 microversion: 2.1 time: 0.156080 Jul 20 17:58:42.811889 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 517/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:58:42 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:15.979160 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-13eff563-d743-4706-8c5b-659ad3f385f7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:15.979772 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-13eff563-d743-4706-8c5b-659ad3f385f7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:15.982062 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=54 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:15.982845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:15.987464 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-13eff563-d743-4706-8c5b-659ad3f385f7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:15.988033 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-13eff563-d743-4706-8c5b-659ad3f385f7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:15.988833 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-13eff563-d743-4706-8c5b-659ad3f385f7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:15.989275 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-13eff563-d743-4706-8c5b-659ad3f385f7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:16.070689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-13eff563-d743-4706-8c5b-659ad3f385f7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lazy-loading 'services' on Instance uuid 2b0962b1-c468-4a10-9a82-363f867efe92 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:59:16.358686 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-13eff563-d743-4706-8c5b-659ad3f385f7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/os-volume_attachments/5c4a0a86-349b-44a2-adc2-4cab9341c82b" status: 202 len: 0 microversion: 2.1 time: 0.383307 Jul 20 17:59:16.359214 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 507/1024] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 17:59:15 2022] DELETE /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/os-volume_attachments/5c4a0a86-349b-44a2-adc2-4cab9341c82b => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:59:18.532119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7d6cc367-041d-4ac0-a7f0-1fddbcea7522 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:59:18.534499 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=52 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:18.535738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=68 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:18.540510 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d6cc367-041d-4ac0-a7f0-1fddbcea7522 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:18.540966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7d6cc367-041d-4ac0-a7f0-1fddbcea7522 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:18.562819 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7d6cc367-041d-4ac0-a7f0-1fddbcea7522 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Going to try to stop instance {{(pid=124846) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 17:59:18.876972 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7d6cc367-041d-4ac0-a7f0-1fddbcea7522 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/action" status: 202 len: 0 microversion: 2.1 time: 0.348510 Jul 20 17:59:18.877500 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 518/1025] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:59:18 2022] POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:59:18.887169 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a664c590-e492-44d3-9257-32d701db3b12 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:18.887906 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a664c590-e492-44d3-9257-32d701db3b12 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:18.894751 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a664c590-e492-44d3-9257-32d701db3b12 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:18.895203 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a664c590-e492-44d3-9257-32d701db3b12 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:18.896003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a664c590-e492-44d3-9257-32d701db3b12 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:18.896458 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a664c590-e492-44d3-9257-32d701db3b12 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:19.029396 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a664c590-e492-44d3-9257-32d701db3b12 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:19.038021 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a664c590-e492-44d3-9257-32d701db3b12 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.155628 Jul 20 17:59:19.038586 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 508/1026] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:18 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:20.056732 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2298df59-8943-4f64-b543-7feef5249282 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:20.057377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2298df59-8943-4f64-b543-7feef5249282 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:20.063560 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2298df59-8943-4f64-b543-7feef5249282 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:20.064015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2298df59-8943-4f64-b543-7feef5249282 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:20.064805 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2298df59-8943-4f64-b543-7feef5249282 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:20.065251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2298df59-8943-4f64-b543-7feef5249282 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:20.200415 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2298df59-8943-4f64-b543-7feef5249282 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:20.208421 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2298df59-8943-4f64-b543-7feef5249282 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.156541 Jul 20 17:59:20.209019 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 519/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:20 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:21.225307 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-52117079-0236-48a8-952d-ee618e8d6513 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:21.225929 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-52117079-0236-48a8-952d-ee618e8d6513 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:21.232491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-52117079-0236-48a8-952d-ee618e8d6513 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:21.232948 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-52117079-0236-48a8-952d-ee618e8d6513 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:21.233720 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-52117079-0236-48a8-952d-ee618e8d6513 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:21.234158 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-52117079-0236-48a8-952d-ee618e8d6513 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:21.360066 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-52117079-0236-48a8-952d-ee618e8d6513 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:21.368123 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-52117079-0236-48a8-952d-ee618e8d6513 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.146687 Jul 20 17:59:21.368728 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 509/1028] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:21 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:22.385520 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-96166eaa-88d4-40bc-8628-d33061fd8554 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:22.386137 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-96166eaa-88d4-40bc-8628-d33061fd8554 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:22.392935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-96166eaa-88d4-40bc-8628-d33061fd8554 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:22.393376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-96166eaa-88d4-40bc-8628-d33061fd8554 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:22.394271 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-96166eaa-88d4-40bc-8628-d33061fd8554 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:22.394728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-96166eaa-88d4-40bc-8628-d33061fd8554 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:22.521027 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-96166eaa-88d4-40bc-8628-d33061fd8554 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:22.528702 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-96166eaa-88d4-40bc-8628-d33061fd8554 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.147057 Jul 20 17:59:22.529281 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 520/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:22 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:23.546181 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a057b882-91ee-4050-af56-d76f73566a1c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:23.546785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a057b882-91ee-4050-af56-d76f73566a1c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:23.553783 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a057b882-91ee-4050-af56-d76f73566a1c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:23.554226 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a057b882-91ee-4050-af56-d76f73566a1c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:23.554978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a057b882-91ee-4050-af56-d76f73566a1c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:23.555406 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a057b882-91ee-4050-af56-d76f73566a1c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:23.690277 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a057b882-91ee-4050-af56-d76f73566a1c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:23.698060 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a057b882-91ee-4050-af56-d76f73566a1c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.155778 Jul 20 17:59:23.698623 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 510/1030] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:23 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:24.714978 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-90512393-5a4e-4a0a-afbb-c2ed09c4b42d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:24.715626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-90512393-5a4e-4a0a-afbb-c2ed09c4b42d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:24.722524 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-90512393-5a4e-4a0a-afbb-c2ed09c4b42d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:24.722976 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-90512393-5a4e-4a0a-afbb-c2ed09c4b42d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:24.723731 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-90512393-5a4e-4a0a-afbb-c2ed09c4b42d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:24.724163 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-90512393-5a4e-4a0a-afbb-c2ed09c4b42d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:24.999913 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-90512393-5a4e-4a0a-afbb-c2ed09c4b42d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:25.007400 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-90512393-5a4e-4a0a-afbb-c2ed09c4b42d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.296283 Jul 20 17:59:25.007966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 521/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:24 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:26.025165 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bc79a7b7-23bb-4d78-a674-b18c91ed8a5b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:26.025822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bc79a7b7-23bb-4d78-a674-b18c91ed8a5b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:26.032297 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc79a7b7-23bb-4d78-a674-b18c91ed8a5b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:26.032773 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc79a7b7-23bb-4d78-a674-b18c91ed8a5b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:26.033529 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc79a7b7-23bb-4d78-a674-b18c91ed8a5b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:26.033957 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bc79a7b7-23bb-4d78-a674-b18c91ed8a5b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:26.167176 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-bc79a7b7-23bb-4d78-a674-b18c91ed8a5b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:26.174572 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bc79a7b7-23bb-4d78-a674-b18c91ed8a5b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.153555 Jul 20 17:59:26.175645 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 511/1032] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:26 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:27.191700 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b2564f78-6187-465e-82bc-0481aeb04a42 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:27.192319 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b2564f78-6187-465e-82bc-0481aeb04a42 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:27.199076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2564f78-6187-465e-82bc-0481aeb04a42 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:27.199517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2564f78-6187-465e-82bc-0481aeb04a42 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:27.200259 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2564f78-6187-465e-82bc-0481aeb04a42 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:27.200807 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-b2564f78-6187-465e-82bc-0481aeb04a42 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:27.330170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b2564f78-6187-465e-82bc-0481aeb04a42 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:27.338564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b2564f78-6187-465e-82bc-0481aeb04a42 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.151235 Jul 20 17:59:27.339120 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 522/1033] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:27 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:28.355595 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a517add9-5faf-44ac-84a5-04d7b7dbce9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:28.356151 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a517add9-5faf-44ac-84a5-04d7b7dbce9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:28.362816 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a517add9-5faf-44ac-84a5-04d7b7dbce9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:28.363250 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a517add9-5faf-44ac-84a5-04d7b7dbce9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:28.364006 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a517add9-5faf-44ac-84a5-04d7b7dbce9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:28.364459 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a517add9-5faf-44ac-84a5-04d7b7dbce9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:28.548161 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a517add9-5faf-44ac-84a5-04d7b7dbce9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:28.556109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a517add9-5faf-44ac-84a5-04d7b7dbce9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.204487 Jul 20 17:59:28.556710 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 512/1034] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:28 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:29.572649 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-02950301-0b4b-40c7-acc3-d58f33c1d65c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:29.573790 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-02950301-0b4b-40c7-acc3-d58f33c1d65c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:29.580420 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02950301-0b4b-40c7-acc3-d58f33c1d65c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:29.580890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02950301-0b4b-40c7-acc3-d58f33c1d65c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:29.582132 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02950301-0b4b-40c7-acc3-d58f33c1d65c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:29.582558 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02950301-0b4b-40c7-acc3-d58f33c1d65c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:29.712997 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-02950301-0b4b-40c7-acc3-d58f33c1d65c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:29.720616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-02950301-0b4b-40c7-acc3-d58f33c1d65c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1677 microversion: 2.1 time: 0.152051 Jul 20 17:59:29.721339 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 523/1035] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:29 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:30.739916 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-dbeb06ff-5251-45f4-9e36-9c204503bb91 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:30.740528 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-dbeb06ff-5251-45f4-9e36-9c204503bb91 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:30.747083 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dbeb06ff-5251-45f4-9e36-9c204503bb91 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:30.747526 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dbeb06ff-5251-45f4-9e36-9c204503bb91 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:30.748275 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dbeb06ff-5251-45f4-9e36-9c204503bb91 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:30.748739 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-dbeb06ff-5251-45f4-9e36-9c204503bb91 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:30.875598 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-dbeb06ff-5251-45f4-9e36-9c204503bb91 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:30.882965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-dbeb06ff-5251-45f4-9e36-9c204503bb91 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1654 microversion: 2.1 time: 0.146888 Jul 20 17:59:30.883521 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 513/1036] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:30 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:30.898925 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d6ee6398-17bd-44aa-8e65-4ee57aa0a6de tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:59:30.905430 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d6ee6398-17bd-44aa-8e65-4ee57aa0a6de tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:30.905922 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d6ee6398-17bd-44aa-8e65-4ee57aa0a6de tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:30.927449 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d6ee6398-17bd-44aa-8e65-4ee57aa0a6de tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Going to try to start instance {{(pid=124846) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 17:59:31.037849 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 17:59:31.038280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Wed Jul 20 17:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/action (ip 10.222.0.42) !!! Jul 20 17:59:31.149898 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d6ee6398-17bd-44aa-8e65-4ee57aa0a6de tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/action" status: 202 len: 0 microversion: 2.1 time: 0.254596 Jul 20 17:59:31.150453 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 524/1037] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jul 20 17:59:30 2022] POST /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 17:59:31.158631 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-14db0c6d-e6ec-499c-9a27-4c269d6cf220 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:31.159246 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-14db0c6d-e6ec-499c-9a27-4c269d6cf220 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:31.165212 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-14db0c6d-e6ec-499c-9a27-4c269d6cf220 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:31.165629 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-14db0c6d-e6ec-499c-9a27-4c269d6cf220 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:31.166393 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-14db0c6d-e6ec-499c-9a27-4c269d6cf220 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:31.166828 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-14db0c6d-e6ec-499c-9a27-4c269d6cf220 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:31.299408 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-14db0c6d-e6ec-499c-9a27-4c269d6cf220 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:31.307288 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-14db0c6d-e6ec-499c-9a27-4c269d6cf220 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1663 microversion: 2.1 time: 0.152646 Jul 20 17:59:31.312808 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 514/1038] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:31 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:32.325119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0fa37dc9-2b7a-4de3-b10e-28523c3f0257 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:32.325815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0fa37dc9-2b7a-4de3-b10e-28523c3f0257 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:32.333486 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0fa37dc9-2b7a-4de3-b10e-28523c3f0257 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:32.333929 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0fa37dc9-2b7a-4de3-b10e-28523c3f0257 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:32.334722 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0fa37dc9-2b7a-4de3-b10e-28523c3f0257 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:32.335152 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0fa37dc9-2b7a-4de3-b10e-28523c3f0257 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:32.463747 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-0fa37dc9-2b7a-4de3-b10e-28523c3f0257 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:32.472490 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0fa37dc9-2b7a-4de3-b10e-28523c3f0257 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1663 microversion: 2.1 time: 0.152357 Jul 20 17:59:32.473053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 525/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:32 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:33.489863 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b8b4454a-10e9-42ba-8218-f5e7fa289f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:33.490480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b8b4454a-10e9-42ba-8218-f5e7fa289f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:33.496965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8b4454a-10e9-42ba-8218-f5e7fa289f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:33.497415 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8b4454a-10e9-42ba-8218-f5e7fa289f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:33.498176 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8b4454a-10e9-42ba-8218-f5e7fa289f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:33.498617 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b8b4454a-10e9-42ba-8218-f5e7fa289f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:33.635969 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b8b4454a-10e9-42ba-8218-f5e7fa289f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:33.643996 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b8b4454a-10e9-42ba-8218-f5e7fa289f6c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1667 microversion: 2.1 time: 0.157508 Jul 20 17:59:33.644600 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 515/1040] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:33 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 17:59:38.823798 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 17:59:38.824347 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Wed Jul 20 17:59:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 17:59:49.312345 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1ec10965-0ea4-479e-923e-d59a0bf4e10b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:49.312988 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1ec10965-0ea4-479e-923e-d59a0bf4e10b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:49.315888 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=16 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:49.316729 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:49.321569 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1ec10965-0ea4-479e-923e-d59a0bf4e10b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:49.322044 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1ec10965-0ea4-479e-923e-d59a0bf4e10b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:49.322796 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1ec10965-0ea4-479e-923e-d59a0bf4e10b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:49.323230 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1ec10965-0ea4-479e-923e-d59a0bf4e10b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:49.347636 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1ec10965-0ea4-479e-923e-d59a0bf4e10b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:59:49.788064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1ec10965-0ea4-479e-923e-d59a0bf4e10b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 204 len: 0 microversion: 2.1 time: 0.479257 Jul 20 17:59:49.788734 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 526/1041] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:59:49 2022] DELETE /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:59:49.806615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b5e8de99-cee6-4973-96dc-d8b9279011e1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:49.806615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b5e8de99-cee6-4973-96dc-d8b9279011e1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:49.806615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=18 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:49.806615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:49.806615 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5e8de99-cee6-4973-96dc-d8b9279011e1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:49.807452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5e8de99-cee6-4973-96dc-d8b9279011e1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:49.807452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5e8de99-cee6-4973-96dc-d8b9279011e1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:49.807452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b5e8de99-cee6-4973-96dc-d8b9279011e1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:49.944001 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b5e8de99-cee6-4973-96dc-d8b9279011e1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:49.953222 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b5e8de99-cee6-4973-96dc-d8b9279011e1 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1576 microversion: 2.1 time: 0.159016 Jul 20 17:59:49.953222 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 516/1042] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:49 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:50.970542 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-1470e162-2741-4bf4-a27c-157c1122fa19 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:50.971238 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-1470e162-2741-4bf4-a27c-157c1122fa19 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:50.978204 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1470e162-2741-4bf4-a27c-157c1122fa19 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:50.978650 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1470e162-2741-4bf4-a27c-157c1122fa19 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:50.979405 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1470e162-2741-4bf4-a27c-157c1122fa19 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:50.979840 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-1470e162-2741-4bf4-a27c-157c1122fa19 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:51.113362 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-1470e162-2741-4bf4-a27c-157c1122fa19 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:51.120932 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-1470e162-2741-4bf4-a27c-157c1122fa19 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1576 microversion: 2.1 time: 0.154704 Jul 20 17:59:51.121491 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 527/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:50 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:52.138220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6e16a416-e865-48a2-8802-c2a9bbdc4a5e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:52.138825 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6e16a416-e865-48a2-8802-c2a9bbdc4a5e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:52.147094 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6e16a416-e865-48a2-8802-c2a9bbdc4a5e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:52.147541 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6e16a416-e865-48a2-8802-c2a9bbdc4a5e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:52.148306 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6e16a416-e865-48a2-8802-c2a9bbdc4a5e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:52.148764 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6e16a416-e865-48a2-8802-c2a9bbdc4a5e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:52.218212 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6e16a416-e865-48a2-8802-c2a9bbdc4a5e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:52.225902 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6e16a416-e865-48a2-8802-c2a9bbdc4a5e tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1508 microversion: 2.1 time: 0.091573 Jul 20 17:59:52.226485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 517/1044] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:52 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1508 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:52.453881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-1dc6805a-1f0e-42f5-8b77-e793708096fd req-117a041d-8380-4abf-8136-0388719b748e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbdc617-0892-491a-9baf-97c8bb00d86a", "name": "network-vif-deleted", "tag": "f2709eb2-b640-45ce-b047-cd5c831cf094"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:59:52.462554 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-1dc6805a-1f0e-42f5-8b77-e793708096fd req-117a041d-8380-4abf-8136-0388719b748e service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:52.462990 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-1dc6805a-1f0e-42f5-8b77-e793708096fd req-117a041d-8380-4abf-8136-0388719b748e service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:52.477116 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-1dc6805a-1f0e-42f5-8b77-e793708096fd req-117a041d-8380-4abf-8136-0388719b748e service nova] Creating event network-vif-deleted:f2709eb2-b640-45ce-b047-cd5c831cf094 for instance 3cbdc617-0892-491a-9baf-97c8bb00d86a on hv-cinder-84984 Jul 20 17:59:52.482717 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-1dc6805a-1f0e-42f5-8b77-e793708096fd req-117a041d-8380-4abf-8136-0388719b748e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033090 Jul 20 17:59:52.483314 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 528/1045] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:59:53.243047 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:53.243693 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:53.250950 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:53.251405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:53.252187 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:53.253259 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:53.288622 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:53.289071 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:53.289533 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lazy-loading 'fault' on Instance uuid 3cbdc617-0892-491a-9baf-97c8bb00d86a {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 17:59:53.333127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:53.340688 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-2bc5de2c-b803-4f60-8b84-2ef3d3f7323a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 200 len: 1229 microversion: 2.1 time: 0.101505 Jul 20 17:59:53.341262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 518/1046] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:53 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:54.358280 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:54.358928 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:54.366085 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:54.366552 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:54.368237 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:54.368237 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:54.381885 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] HTTP exception thrown: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Request method failure captured: Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a HTTP/1.1 Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EHkB9X-W9u1AXPktfbc67p2akARB0zxGQo1NwsEnBd69tV2k03ACyc0c3QbThzhHRvlJ6KLa4Ai8W2pGZoSV_U8J1MCE2JXJMMcyfmw_9VRtyHh_5oTwTbCA-JLmOQaIg9akJ8S-IKz3ilozfE_cG5CYBdsJlFnNpyAvYFC4MXT5GA Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 17:59:54.383480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be1213650f38494aa2aeb1aadc7ccbc7"}]}] Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-TestVolumeBootPattern-35907800 Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-TestVolumeBootPattern-35907800-project Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 9c95e9df33ad4f819f26fb8b695df7e9 Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-TestVolumeBootPattern-35907800-project Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 17:59:54.385165 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '3cbdc617-0892-491a-9baf-97c8bb00d86a'} Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 17:59:54.386206 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 17:59:54.387793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 17:59:54.389368 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Returning 404 to user: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 17:59:54.389368 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9bf4f5fa-d264-4781-bbf0-291e99518dfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 404 len: 111 microversion: 2.1 time: 0.030975 Jul 20 17:59:54.389368 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 529/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:54 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 17:59:54.479489 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-154569097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-240885777", "security_groups": [{"name": "tempest-secgroup-smoke-1389441536"}], "block_device_mapping_v2": [{"uuid": "8715c484-a269-4e30-bd2c-1704a5a4d75e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d856af6c-3171-430a-a397-90532200f85e"}]}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:59:54.594178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.network.neutron [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] validate_networks() for [('d856af6c-3171-430a-a397-90532200f85e', None, None, None, None, None)] {{(pid=124845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 17:59:54.970217 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Flavor limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 17:59:54.970643 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Image limits 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 17:59:54.971118 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Flavor pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 17:59:54.972030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Image pref 0:0:0 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 17:59:54.972471 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.virt.hardware [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 17:59:54.981285 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:54.981733 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:54.982538 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:54.982988 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:54.999857 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Getting quotas for project be1213650f38494aa2aeb1aadc7ccbc7. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 17:59:55.004624 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Getting quotas for user 9c95e9df33ad4f819f26fb8b695df7e9 and project be1213650f38494aa2aeb1aadc7ccbc7. Resources: {'ram', 'instances', 'cores'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 17:59:55.063542 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Going to run 1 instances... {{(pid=124845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 17:59:55.066283 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8715c484-a269-4e30-bd2c-1704a5a4d75e',volume_size=None,volume_type=None)] {{(pid=124845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 17:59:55.673673 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-67ed4106-5c82-4d0d-a4b8-f227d0c0762c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.198014 Jul 20 17:59:55.675036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 519/1048] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 17:59:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 17:59:55.684371 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2333cf9f-5f55-4ab7-b048-945f27e2fedb tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:55.685019 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2333cf9f-5f55-4ab7-b048-945f27e2fedb tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:55.739317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-2333cf9f-5f55-4ab7-b048-945f27e2fedb tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:55.747044 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2333cf9f-5f55-4ab7-b048-945f27e2fedb tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1093 microversion: 2.1 time: 0.065843 Jul 20 17:59:55.747619 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 530/1049] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:55 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:56.765282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8dee6c48-4e4c-4bfb-96a7-70cd5bebb5e6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:56.765920 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8dee6c48-4e4c-4bfb-96a7-70cd5bebb5e6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:56.773234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8dee6c48-4e4c-4bfb-96a7-70cd5bebb5e6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:56.773687 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8dee6c48-4e4c-4bfb-96a7-70cd5bebb5e6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:56.774466 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8dee6c48-4e4c-4bfb-96a7-70cd5bebb5e6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:56.774906 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8dee6c48-4e4c-4bfb-96a7-70cd5bebb5e6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:56.858618 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8dee6c48-4e4c-4bfb-96a7-70cd5bebb5e6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:56.866968 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8dee6c48-4e4c-4bfb-96a7-70cd5bebb5e6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1143 microversion: 2.1 time: 0.106268 Jul 20 17:59:56.867552 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 520/1050] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:56 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1143 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:57.028600 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c915e14f-1594-41b7-96eb-aa577cb86a00 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:57.029105 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c915e14f-1594-41b7-96eb-aa577cb86a00 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:57.043952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c915e14f-1594-41b7-96eb-aa577cb86a00 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:57.043952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c915e14f-1594-41b7-96eb-aa577cb86a00 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:57.043952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c915e14f-1594-41b7-96eb-aa577cb86a00 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:57.043952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c915e14f-1594-41b7-96eb-aa577cb86a00 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:57.064490 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c915e14f-1594-41b7-96eb-aa577cb86a00 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 17:59:57.097153 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-d065c20b-378e-4d2e-a0e8-d17c1b1e8b44 req-978b5c3f-e369-4d75-b400-1df544cdae54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940b1e17-6334-434f-a6f4-ea98310e44f9", "tag": "0d2efd3e-013a-4a3b-bc60-84e6553804e3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 17:59:57.107279 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-d065c20b-378e-4d2e-a0e8-d17c1b1e8b44 req-978b5c3f-e369-4d75-b400-1df544cdae54 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:57.107728 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-d065c20b-378e-4d2e-a0e8-d17c1b1e8b44 req-978b5c3f-e369-4d75-b400-1df544cdae54 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:57.119245 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-d065c20b-378e-4d2e-a0e8-d17c1b1e8b44 req-978b5c3f-e369-4d75-b400-1df544cdae54 service nova] Creating event network-changed:0d2efd3e-013a-4a3b-bc60-84e6553804e3 for instance 940b1e17-6334-434f-a6f4-ea98310e44f9 on hv-cinder-84984 Jul 20 17:59:57.124747 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-d065c20b-378e-4d2e-a0e8-d17c1b1e8b44 req-978b5c3f-e369-4d75-b400-1df544cdae54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097590 Jul 20 17:59:57.125345 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 521/1051] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 17:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 17:59:57.526416 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c915e14f-1594-41b7-96eb-aa577cb86a00 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "DELETE /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 204 len: 0 microversion: 2.1 time: 0.501155 Jul 20 17:59:57.527077 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 531/1052] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 17:59:57 2022] DELETE /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 17:59:57.536094 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-eeda26b2-a6be-42b0-b447-29c498311df6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:57.536822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-eeda26b2-a6be-42b0-b447-29c498311df6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:57.543454 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eeda26b2-a6be-42b0-b447-29c498311df6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:57.543978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eeda26b2-a6be-42b0-b447-29c498311df6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:57.544900 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eeda26b2-a6be-42b0-b447-29c498311df6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:57.545611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-eeda26b2-a6be-42b0-b447-29c498311df6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:57.685704 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-eeda26b2-a6be-42b0-b447-29c498311df6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:57.695147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-eeda26b2-a6be-42b0-b447-29c498311df6 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.163092 Jul 20 17:59:57.696267 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 522/1053] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:57 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:57.884040 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-02af3258-1306-4196-9d3f-f28ac888296c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:57.884807 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-02af3258-1306-4196-9d3f-f28ac888296c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:57.891095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02af3258-1306-4196-9d3f-f28ac888296c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:57.896466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02af3258-1306-4196-9d3f-f28ac888296c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:57.896466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02af3258-1306-4196-9d3f-f28ac888296c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:57.896466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-02af3258-1306-4196-9d3f-f28ac888296c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:57.957045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-02af3258-1306-4196-9d3f-f28ac888296c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:57.964596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-02af3258-1306-4196-9d3f-f28ac888296c tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1191 microversion: 2.1 time: 0.085010 Jul 20 17:59:57.965171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 532/1054] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:57 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:58.716414 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d1ffdb62-8bd7-488d-805c-b12b6dbb7046 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:58.717060 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d1ffdb62-8bd7-488d-805c-b12b6dbb7046 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:58.723960 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d1ffdb62-8bd7-488d-805c-b12b6dbb7046 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:58.724502 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d1ffdb62-8bd7-488d-805c-b12b6dbb7046 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:58.725276 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d1ffdb62-8bd7-488d-805c-b12b6dbb7046 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:58.725712 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d1ffdb62-8bd7-488d-805c-b12b6dbb7046 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:58.865355 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d1ffdb62-8bd7-488d-805c-b12b6dbb7046 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:58.873039 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d1ffdb62-8bd7-488d-805c-b12b6dbb7046 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1568 microversion: 2.1 time: 0.160480 Jul 20 17:59:58.873611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 523/1055] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:58 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:58.982242 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-050fa686-08e3-4272-b041-13beb83801ff tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:58.982774 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-050fa686-08e3-4272-b041-13beb83801ff tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:58.989432 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-050fa686-08e3-4272-b041-13beb83801ff tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:58.989887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-050fa686-08e3-4272-b041-13beb83801ff tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:58.990660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-050fa686-08e3-4272-b041-13beb83801ff tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:58.991100 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-050fa686-08e3-4272-b041-13beb83801ff tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:59.053363 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-050fa686-08e3-4272-b041-13beb83801ff tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 17:59:59.060731 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-050fa686-08e3-4272-b041-13beb83801ff tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1191 microversion: 2.1 time: 0.082690 Jul 20 17:59:59.061303 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 533/1056] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:58 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 17:59:59.890600 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7a172579-f269-4d95-adb3-026b636ca630 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 17:59:59.891546 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7a172579-f269-4d95-adb3-026b636ca630 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 17:59:59.899068 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a172579-f269-4d95-adb3-026b636ca630 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:59.899978 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a172579-f269-4d95-adb3-026b636ca630 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 17:59:59.900497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a172579-f269-4d95-adb3-026b636ca630 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 17:59:59.901178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7a172579-f269-4d95-adb3-026b636ca630 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:00.077666 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-40aa952e-729a-471f-b270-e5cb3e490ed0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:00.089228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-40aa952e-729a-471f-b270-e5cb3e490ed0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:00.089228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-40aa952e-729a-471f-b270-e5cb3e490ed0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:00.089228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-40aa952e-729a-471f-b270-e5cb3e490ed0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:00.089228 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-40aa952e-729a-471f-b270-e5cb3e490ed0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:00.089608 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-40aa952e-729a-471f-b270-e5cb3e490ed0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:00.131411 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7a172579-f269-4d95-adb3-026b636ca630 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:00.139575 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7a172579-f269-4d95-adb3-026b636ca630 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1449 microversion: 2.1 time: 0.252975 Jul 20 18:00:00.140366 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 524/1057] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 17:59:59 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1449 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:00.161479 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-40aa952e-729a-471f-b270-e5cb3e490ed0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:00.169364 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-40aa952e-729a-471f-b270-e5cb3e490ed0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1199 microversion: 2.1 time: 0.095856 Jul 20 18:00:00.170041 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 534/1058] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:00 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:00.489921 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-4aef1dce-a3bd-495e-8da5-da58f65fb125 req-fc8efb69-59bf-4c91-8566-2279659182c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940b1e17-6334-434f-a6f4-ea98310e44f9", "name": "network-vif-deleted", "tag": "0d2efd3e-013a-4a3b-bc60-84e6553804e3"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:00.498599 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-4aef1dce-a3bd-495e-8da5-da58f65fb125 req-fc8efb69-59bf-4c91-8566-2279659182c7 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:00.499046 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-4aef1dce-a3bd-495e-8da5-da58f65fb125 req-fc8efb69-59bf-4c91-8566-2279659182c7 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:00.516974 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-4aef1dce-a3bd-495e-8da5-da58f65fb125 req-fc8efb69-59bf-4c91-8566-2279659182c7 service nova] Creating event network-vif-deleted:0d2efd3e-013a-4a3b-bc60-84e6553804e3 for instance 940b1e17-6334-434f-a6f4-ea98310e44f9 on hv-cinder-84984 Jul 20 18:00:00.521989 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-4aef1dce-a3bd-495e-8da5-da58f65fb125 req-fc8efb69-59bf-4c91-8566-2279659182c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036545 Jul 20 18:00:00.522592 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 525/1059] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:00:01.165684 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d7f8c983-652d-4a57-b33c-e67261115cac tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:01.171053 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d7f8c983-652d-4a57-b33c-e67261115cac tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:01.187920 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d7f8c983-652d-4a57-b33c-e67261115cac tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:01.188377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d7f8c983-652d-4a57-b33c-e67261115cac tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:01.189425 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b6a190ae-052f-4c2d-a2db-4abb5335ad6d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:01.191700 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d7f8c983-652d-4a57-b33c-e67261115cac tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:01.191864 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b6a190ae-052f-4c2d-a2db-4abb5335ad6d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:01.194753 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d7f8c983-652d-4a57-b33c-e67261115cac tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:01.200936 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b6a190ae-052f-4c2d-a2db-4abb5335ad6d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:01.203166 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b6a190ae-052f-4c2d-a2db-4abb5335ad6d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:01.204713 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b6a190ae-052f-4c2d-a2db-4abb5335ad6d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:01.205613 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b6a190ae-052f-4c2d-a2db-4abb5335ad6d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:01.348594 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d7f8c983-652d-4a57-b33c-e67261115cac tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:01.356485 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d7f8c983-652d-4a57-b33c-e67261115cac tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1219 microversion: 2.1 time: 0.198050 Jul 20 18:00:01.357435 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 535/1060] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:01 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1219 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:01.491421 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b6a190ae-052f-4c2d-a2db-4abb5335ad6d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:01.499070 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b6a190ae-052f-4c2d-a2db-4abb5335ad6d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1277 microversion: 2.1 time: 0.314555 Jul 20 18:00:01.499540 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 526/1061] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:01 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:02.109386 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-3d7544e5-d820-491e-9a8d-ba22ddfda1ef req-a01b8ea6-230b-4ab7-a705-e002acb053d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe7e7c5-28ce-436c-bdf2-486e17cd8928", "tag": "15690f10-2ae5-4510-a8e1-752ef9c31ba6"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:02.126407 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-3d7544e5-d820-491e-9a8d-ba22ddfda1ef req-a01b8ea6-230b-4ab7-a705-e002acb053d4 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:02.126407 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-3d7544e5-d820-491e-9a8d-ba22ddfda1ef req-a01b8ea6-230b-4ab7-a705-e002acb053d4 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:02.136775 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-3d7544e5-d820-491e-9a8d-ba22ddfda1ef req-a01b8ea6-230b-4ab7-a705-e002acb053d4 service nova] Creating event network-changed:15690f10-2ae5-4510-a8e1-752ef9c31ba6 for instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 on hv-cinder-84984 Jul 20 18:00:02.141761 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-3d7544e5-d820-491e-9a8d-ba22ddfda1ef req-a01b8ea6-230b-4ab7-a705-e002acb053d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041480 Jul 20 18:00:02.142366 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 536/1062] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:00:02.374228 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:02.374775 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:02.381792 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:02.382245 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:02.383007 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:02.383435 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:02.415426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:02.415873 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:02.416313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lazy-loading 'fault' on Instance uuid 940b1e17-6334-434f-a6f4-ea98310e44f9 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 18:00:02.487557 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcc8275481e41f38bbdfac7db67b2e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863e2e49ffb74a889fb88c4c2e7edcd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:02.496147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-57f8ab98-c6d1-4d2f-8065-1f49566f26c8 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 200 len: 1178 microversion: 2.1 time: 0.125295 Jul 20 18:00:02.506219 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 527/1063] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:02 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 1178 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:02.517002 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ba0f55c5-e76b-4bb9-8878-3990d5251841 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:02.518937 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ba0f55c5-e76b-4bb9-8878-3990d5251841 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:02.525650 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba0f55c5-e76b-4bb9-8878-3990d5251841 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:02.526106 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba0f55c5-e76b-4bb9-8878-3990d5251841 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:02.526879 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba0f55c5-e76b-4bb9-8878-3990d5251841 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:02.527381 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba0f55c5-e76b-4bb9-8878-3990d5251841 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:02.746201 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ba0f55c5-e76b-4bb9-8878-3990d5251841 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:02.754668 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ba0f55c5-e76b-4bb9-8878-3990d5251841 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.241917 Jul 20 18:00:02.755335 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 537/1064] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:02 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:03.514883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:03.515497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [instance: 940b1e17-6334-434f-a6f4-ea98310e44f9] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:03.522054 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:03.522595 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:03.523360 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:03.523797 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:03.536996 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] HTTP exception thrown: Instance 940b1e17-6334-434f-a6f4-ea98310e44f9 could not be found. Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Request method failure captured: Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 HTTP/1.1 Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EGDHIm0eEy9zUwG7llPQ0f3IdHG2ZlaFk8U_xRBakVBTQjknNEmOCwTn6g4iECTQY7xt3pGzUiPddWrQRdkbz2tHCbfrJ1wMx2cBY0m2as0A4AQs6bvepe1Z6e57Y8ZMgJfELpVLWyWmJ0RDsiqvM0nE8IG6mdywhKUHVfQA8_sEWY Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 863e2e49ffb74a889fb88c4c2e7edcd4 Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-TestShelveInstance-285442041 Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 18:00:03.538637 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_863e2e49ffb74a889fb88c4c2e7edcd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863e2e49ffb74a889fb88c4c2e7edcd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863e2e49ffb74a889fb88c4c2e7edcd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/863e2e49ffb74a889fb88c4c2e7edcd4"}]}] Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-TestShelveInstance-285442041 Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 863e2e49ffb74a889fb88c4c2e7edcd4 Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-TestShelveInstance-285442041 Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-TestShelveInstance-285442041-project Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 0fcc8275481e41f38bbdfac7db67b2e5 Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-TestShelveInstance-285442041-project Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 940b1e17-6334-434f-a6f4-ea98310e44f9 could not be found. Jul 20 18:00:03.540287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '940b1e17-6334-434f-a6f4-ea98310e44f9'} Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940b1e17-6334-434f-a6f4-ea98310e44f9 could not be found. Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:00:03.546229 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940b1e17-6334-434f-a6f4-ea98310e44f9 could not be found. Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940b1e17-6334-434f-a6f4-ea98310e44f9 could not be found. Jul 20 18:00:03.548236 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:00:03.550147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Returning 404 to user: Instance 940b1e17-6334-434f-a6f4-ea98310e44f9 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:00:03.550147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c90b75a7-e9e3-4165-90c6-0e09dc03bb22 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9" status: 404 len: 111 microversion: 2.1 time: 0.029274 Jul 20 18:00:03.550147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 528/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:03 2022] GET /compute/v2.1/servers/940b1e17-6334-434f-a6f4-ea98310e44f9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:00:03.772404 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-812d6388-1d68-4c16-b01b-2b660499b21d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:03.772979 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-812d6388-1d68-4c16-b01b-2b660499b21d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:03.779604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-812d6388-1d68-4c16-b01b-2b660499b21d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:03.785947 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-812d6388-1d68-4c16-b01b-2b660499b21d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:03.785947 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-812d6388-1d68-4c16-b01b-2b660499b21d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:03.785947 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-812d6388-1d68-4c16-b01b-2b660499b21d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:03.827299 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3775f5af-9f9d-44c1-9482-65346eb50282 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] Calling method '.version_select at 0x7f7d3d5e9940>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:03.833199 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3775f5af-9f9d-44c1-9482-65346eb50282 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [6bb17f73-a8e0-4679-a2d9-518395ffb737] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 18:00:04.155465 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-812d6388-1d68-4c16-b01b-2b660499b21d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:04.162970 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-812d6388-1d68-4c16-b01b-2b660499b21d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.395097 Jul 20 18:00:04.163529 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 538/1066] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:03 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:04.839865 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [None req-3775f5af-9f9d-44c1-9482-65346eb50282 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] [6bb17f73-a8e0-4679-a2d9-518395ffb737] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49874. Jul 20 18:00:04.991041 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:05.011391 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=6 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:05.057379 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3775f5af-9f9d-44c1-9482-65346eb50282 tempest-TestShelveInstance-285442041 tempest-TestShelveInstance-285442041-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1477429252" status: 202 len: 0 microversion: 2.1 time: 1.234072 Jul 20 18:00:05.057976 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 529/1067] 10.222.0.42 () {58 vars in 1253 bytes} [Wed Jul 20 18:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1477429252 => generated 0 bytes in 1235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 18:00:05.179822 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cab17d9e-a6dd-49d5-97a2-bfedb1683403 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:05.180457 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cab17d9e-a6dd-49d5-97a2-bfedb1683403 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:05.186979 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cab17d9e-a6dd-49d5-97a2-bfedb1683403 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:05.187429 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cab17d9e-a6dd-49d5-97a2-bfedb1683403 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:05.188205 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cab17d9e-a6dd-49d5-97a2-bfedb1683403 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:05.188701 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cab17d9e-a6dd-49d5-97a2-bfedb1683403 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:05.319966 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cab17d9e-a6dd-49d5-97a2-bfedb1683403 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:05.327808 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cab17d9e-a6dd-49d5-97a2-bfedb1683403 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.152020 Jul 20 18:00:05.328379 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 539/1068] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:05 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:06.345763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-98a6be24-401c-4d82-aa86-22e2b58ffee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:06.346346 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-98a6be24-401c-4d82-aa86-22e2b58ffee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:06.353304 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98a6be24-401c-4d82-aa86-22e2b58ffee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:06.353760 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98a6be24-401c-4d82-aa86-22e2b58ffee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:06.354527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98a6be24-401c-4d82-aa86-22e2b58ffee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:06.354963 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-98a6be24-401c-4d82-aa86-22e2b58ffee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:06.487567 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-98a6be24-401c-4d82-aa86-22e2b58ffee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:06.495159 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-98a6be24-401c-4d82-aa86-22e2b58ffee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.153994 Jul 20 18:00:06.495735 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 530/1069] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:06 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:07.355537 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0c47be62-3698-4949-9f90-4bdac304e438 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:07.356755 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0c47be62-3698-4949-9f90-4bdac304e438 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:07.358948 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:07.364282 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0c47be62-3698-4949-9f90-4bdac304e438 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:07.372219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0c47be62-3698-4949-9f90-4bdac304e438 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:07.372219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0c47be62-3698-4949-9f90-4bdac304e438 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:07.372219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0c47be62-3698-4949-9f90-4bdac304e438 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:07.394876 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0c47be62-3698-4949-9f90-4bdac304e438 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043267 Jul 20 18:00:07.395459 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 540/1070] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 18:00:07 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 18:00:07.454919 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-664ea618-a55a-4885-9e2b-9b5cf9fd4de3 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:07.455983 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-664ea618-a55a-4885-9e2b-9b5cf9fd4de3 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:07.462458 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-664ea618-a55a-4885-9e2b-9b5cf9fd4de3 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:07.462910 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-664ea618-a55a-4885-9e2b-9b5cf9fd4de3 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:07.463675 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-664ea618-a55a-4885-9e2b-9b5cf9fd4de3 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:07.464113 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-664ea618-a55a-4885-9e2b-9b5cf9fd4de3 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:07.489604 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-664ea618-a55a-4885-9e2b-9b5cf9fd4de3 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 18:00:07.512557 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-673a6bd5-7122-4f31-933c-ee5c511cbc43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:07.513947 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-673a6bd5-7122-4f31-933c-ee5c511cbc43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:07.520740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-673a6bd5-7122-4f31-933c-ee5c511cbc43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:07.521283 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-673a6bd5-7122-4f31-933c-ee5c511cbc43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:07.522137 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-673a6bd5-7122-4f31-933c-ee5c511cbc43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:07.523001 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-673a6bd5-7122-4f31-933c-ee5c511cbc43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:07.663123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-673a6bd5-7122-4f31-933c-ee5c511cbc43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:07.671124 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-673a6bd5-7122-4f31-933c-ee5c511cbc43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.162083 Jul 20 18:00:07.671710 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 541/1071] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:07 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:08.044673 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-664ea618-a55a-4885-9e2b-9b5cf9fd4de3 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 204 len: 0 microversion: 2.1 time: 0.593245 Jul 20 18:00:08.045271 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 531/1072] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 18:00:07 2022] DELETE /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 18:00:08.054008 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7f878a5d-8b66-43b0-864b-f89658229c64 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:08.054616 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7f878a5d-8b66-43b0-864b-f89658229c64 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:08.060589 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f878a5d-8b66-43b0-864b-f89658229c64 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:08.061036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f878a5d-8b66-43b0-864b-f89658229c64 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:08.061783 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f878a5d-8b66-43b0-864b-f89658229c64 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:08.062213 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f878a5d-8b66-43b0-864b-f89658229c64 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:08.066698 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:08.221161 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7f878a5d-8b66-43b0-864b-f89658229c64 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:08.229488 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7f878a5d-8b66-43b0-864b-f89658229c64 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1673 microversion: 2.1 time: 0.179879 Jul 20 18:00:08.234440 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 542/1073] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:08 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:08.689434 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8bfd617a-d810-4db2-b11c-9fe6ec1fdce3 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:08.690790 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8bfd617a-d810-4db2-b11c-9fe6ec1fdce3 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:08.697858 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bfd617a-d810-4db2-b11c-9fe6ec1fdce3 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:08.698314 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bfd617a-d810-4db2-b11c-9fe6ec1fdce3 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:08.699099 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bfd617a-d810-4db2-b11c-9fe6ec1fdce3 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:08.699530 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8bfd617a-d810-4db2-b11c-9fe6ec1fdce3 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:08.855310 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8bfd617a-d810-4db2-b11c-9fe6ec1fdce3 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:08.863920 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8bfd617a-d810-4db2-b11c-9fe6ec1fdce3 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.178958 Jul 20 18:00:08.864795 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 532/1074] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:08 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:09.246853 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ca347bb5-0450-496d-be11-9fccd17e6076 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:09.247461 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ca347bb5-0450-496d-be11-9fccd17e6076 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:09.256922 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ca347bb5-0450-496d-be11-9fccd17e6076 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:09.257479 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ca347bb5-0450-496d-be11-9fccd17e6076 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:09.258323 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ca347bb5-0450-496d-be11-9fccd17e6076 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:09.258825 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ca347bb5-0450-496d-be11-9fccd17e6076 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:09.487288 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ca347bb5-0450-496d-be11-9fccd17e6076 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:09.494971 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ca347bb5-0450-496d-be11-9fccd17e6076 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1673 microversion: 2.1 time: 0.252097 Jul 20 18:00:09.495553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 543/1075] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:09 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:09.880845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3a78bb9f-392b-4f73-b897-d98796489f7d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:09.882016 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3a78bb9f-392b-4f73-b897-d98796489f7d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:09.889156 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a78bb9f-392b-4f73-b897-d98796489f7d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:09.900963 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a78bb9f-392b-4f73-b897-d98796489f7d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:09.900963 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a78bb9f-392b-4f73-b897-d98796489f7d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:09.900963 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3a78bb9f-392b-4f73-b897-d98796489f7d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:10.131126 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3a78bb9f-392b-4f73-b897-d98796489f7d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:10.134961 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:10.139903 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3a78bb9f-392b-4f73-b897-d98796489f7d tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.263405 Jul 20 18:00:10.141754 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 533/1076] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:09 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:10.511296 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5691c455-532b-4f03-8ce6-aa3445a72df0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:10.511972 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5691c455-532b-4f03-8ce6-aa3445a72df0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:10.518525 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5691c455-532b-4f03-8ce6-aa3445a72df0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:10.519822 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5691c455-532b-4f03-8ce6-aa3445a72df0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:10.520705 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5691c455-532b-4f03-8ce6-aa3445a72df0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:10.521219 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5691c455-532b-4f03-8ce6-aa3445a72df0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:10.862323 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-5691c455-532b-4f03-8ce6-aa3445a72df0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:10.871105 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5691c455-532b-4f03-8ce6-aa3445a72df0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1673 microversion: 2.1 time: 0.363864 Jul 20 18:00:10.871674 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 544/1077] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:10 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1673 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:11.157465 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4ef9f85f-b402-458b-9c3a-30a0204e7eda tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:11.158130 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4ef9f85f-b402-458b-9c3a-30a0204e7eda tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:11.165857 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ef9f85f-b402-458b-9c3a-30a0204e7eda tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:11.166335 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ef9f85f-b402-458b-9c3a-30a0204e7eda tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:11.167126 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ef9f85f-b402-458b-9c3a-30a0204e7eda tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:11.167562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4ef9f85f-b402-458b-9c3a-30a0204e7eda tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:11.644791 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4ef9f85f-b402-458b-9c3a-30a0204e7eda tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:11.654310 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4ef9f85f-b402-458b-9c3a-30a0204e7eda tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.500327 Jul 20 18:00:11.655044 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 534/1078] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:11 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:11.888614 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ba649786-3a53-4af8-a3d3-df4cd7b067b2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:11.889305 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ba649786-3a53-4af8-a3d3-df4cd7b067b2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:11.897659 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba649786-3a53-4af8-a3d3-df4cd7b067b2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:11.898407 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba649786-3a53-4af8-a3d3-df4cd7b067b2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:11.899935 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba649786-3a53-4af8-a3d3-df4cd7b067b2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:11.900596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba649786-3a53-4af8-a3d3-df4cd7b067b2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:12.067604 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ba649786-3a53-4af8-a3d3-df4cd7b067b2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:12.078210 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ba649786-3a53-4af8-a3d3-df4cd7b067b2 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1673 microversion: 2.1 time: 0.193072 Jul 20 18:00:12.078676 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 545/1079] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:11 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:12.536805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-c7bbf799-30d0-42ae-b6f5-52644720377a req-54412e80-c9a0-4cf0-bf2d-c621cb9c3229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0962b1-c468-4a10-9a82-363f867efe92", "name": "network-vif-deleted", "tag": "5e2b818c-70ef-44b0-af2e-182b4029ca2f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:12.546355 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c7bbf799-30d0-42ae-b6f5-52644720377a req-54412e80-c9a0-4cf0-bf2d-c621cb9c3229 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:12.547065 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-c7bbf799-30d0-42ae-b6f5-52644720377a req-54412e80-c9a0-4cf0-bf2d-c621cb9c3229 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:12.563324 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-c7bbf799-30d0-42ae-b6f5-52644720377a req-54412e80-c9a0-4cf0-bf2d-c621cb9c3229 service nova] Creating event network-vif-deleted:5e2b818c-70ef-44b0-af2e-182b4029ca2f for instance 2b0962b1-c468-4a10-9a82-363f867efe92 on hv-cinder-84984 Jul 20 18:00:12.580045 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-c7bbf799-30d0-42ae-b6f5-52644720377a req-54412e80-c9a0-4cf0-bf2d-c621cb9c3229 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044604 Jul 20 18:00:12.581895 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 535/1080] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:00:12.672312 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d8d693ad-2e38-4984-af2e-ca34d7a19e43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:12.673395 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d8d693ad-2e38-4984-af2e-ca34d7a19e43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:12.685583 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d8d693ad-2e38-4984-af2e-ca34d7a19e43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:12.686036 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d8d693ad-2e38-4984-af2e-ca34d7a19e43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:12.687059 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d8d693ad-2e38-4984-af2e-ca34d7a19e43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:12.687815 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d8d693ad-2e38-4984-af2e-ca34d7a19e43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:12.927500 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d8d693ad-2e38-4984-af2e-ca34d7a19e43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:12.932908 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d8d693ad-2e38-4984-af2e-ca34d7a19e43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.264930 Jul 20 18:00:12.942884 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 546/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:12 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:13.126172 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:13.127953 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:13.134564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:13.135019 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:13.136043 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:13.136735 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:13.176333 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:13.182595 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:13.183180 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lazy-loading 'fault' on Instance uuid 2b0962b1-c468-4a10-9a82-363f867efe92 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 18:00:13.256080 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:13.264470 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-872edb27-83c9-4041-b55d-43c892063686 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 200 len: 1327 microversion: 2.1 time: 0.172764 Jul 20 18:00:13.265303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 536/1082] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:13 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 1327 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:13.533154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-56aa8c19-0e7b-4bd4-99aa-730bbdb62603 req-9b19cb38-2006-4a94-b743-f1b37e1f65b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe7e7c5-28ce-436c-bdf2-486e17cd8928", "name": "network-vif-plugged", "status": "completed", "tag": "15690f10-2ae5-4510-a8e1-752ef9c31ba6"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:13.542152 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-56aa8c19-0e7b-4bd4-99aa-730bbdb62603 req-9b19cb38-2006-4a94-b743-f1b37e1f65b3 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:13.542595 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-56aa8c19-0e7b-4bd4-99aa-730bbdb62603 req-9b19cb38-2006-4a94-b743-f1b37e1f65b3 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:13.554562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-56aa8c19-0e7b-4bd4-99aa-730bbdb62603 req-9b19cb38-2006-4a94-b743-f1b37e1f65b3 service nova] Creating event network-vif-plugged:15690f10-2ae5-4510-a8e1-752ef9c31ba6 for instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 on hv-cinder-84984 Jul 20 18:00:13.559657 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-56aa8c19-0e7b-4bd4-99aa-730bbdb62603 req-9b19cb38-2006-4a94-b743-f1b37e1f65b3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031107 Jul 20 18:00:13.560270 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 547/1083] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:00:13.951119 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b576bbba-c636-4253-89a9-573b07f81b3a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:13.952333 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b576bbba-c636-4253-89a9-573b07f81b3a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:13.959502 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b576bbba-c636-4253-89a9-573b07f81b3a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:13.959952 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b576bbba-c636-4253-89a9-573b07f81b3a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:13.960750 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b576bbba-c636-4253-89a9-573b07f81b3a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:13.961248 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b576bbba-c636-4253-89a9-573b07f81b3a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:14.115602 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-b576bbba-c636-4253-89a9-573b07f81b3a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:14.123185 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b576bbba-c636-4253-89a9-573b07f81b3a tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.175949 Jul 20 18:00:14.123751 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 537/1084] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:13 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:14.283210 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:14.283942 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:14.290666 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:14.291114 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:14.291869 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:14.292308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:14.305297 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] HTTP exception thrown: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Request method failure captured: Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 HTTP/1.1 Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EH5xNuxVADOjDa6x7QFfff0OztZOmMq_8m-Ni7WgjddodUU4No1qJRuOeZ4pLyHbK_MmU-frhMNN-t5SSp0BIqTLGoNOFF71Mm-G88X3pUbdFPD14FYSlbGT_XSQEfu44C4UpLrCOq6wUE4dw1tGkEAKA5zyu9yeIF8CFg0TuZHMAU Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 18:00:14.306883 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/958d3fd7755a4e0b8419e92a26656e2d"}]}] Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: de1ce4a75440478d957a3a03d41dbffd Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:00:14.308508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '2b0962b1-c468-4a10-9a82-363f867efe92'} Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:00:14.309473 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:00:14.310959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:00:14.312365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Returning 404 to user: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:00:14.312365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-706d7b9c-d4c3-459d-a688-299cfe46a85b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 404 len: 111 microversion: 2.1 time: 0.029312 Jul 20 18:00:14.312365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 548/1085] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:14 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 18:00:14.317752 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-02b26bcd-d500-46df-a74c-616d59bba418 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '.version_select at 0x7f7d3df5ef70>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:14.508892 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-02b26bcd-d500-46df-a74c-616d59bba418 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614733709" status: 202 len: 0 microversion: 2.1 time: 0.195381 Jul 20 18:00:14.509409 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 538/1086] 10.222.0.42 () {58 vars in 1217 bytes} [Wed Jul 20 18:00:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614733709 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 18:00:15.140609 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9b535587-8110-468e-ac21-da539cba1d28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:15.141518 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9b535587-8110-468e-ac21-da539cba1d28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:15.152208 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9b535587-8110-468e-ac21-da539cba1d28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:15.152995 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9b535587-8110-468e-ac21-da539cba1d28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:15.154107 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9b535587-8110-468e-ac21-da539cba1d28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:15.154635 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9b535587-8110-468e-ac21-da539cba1d28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:15.309463 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9b535587-8110-468e-ac21-da539cba1d28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:15.317322 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9b535587-8110-468e-ac21-da539cba1d28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1265 microversion: 2.1 time: 0.181945 Jul 20 18:00:15.317887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 549/1087] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:15 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:15.630898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b286114f-8c4c-4802-8501-abbbb8e65ff7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'create', calling method: .version_select at 0x7f7d3e1ac5e0>, body: {"keypair": {"name": "tempest-keypair-110631631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKamn+T3Omg7PVWDNZN31LlR9I1kLO32VCpp8XbaAdxg2BpFdN6BpqUVpTEdPbsjbp3FH5tI/5VhENUU9ymXYXDzS45VJIuKzj0hwvA3FMy6qsIeaU5FLV164nNOMeHD/w=="}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:15.645638 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-b286114f-8c4c-4802-8501-abbbb8e65ff7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Getting quotas for project 958d3fd7755a4e0b8419e92a26656e2d. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 18:00:15.649664 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.quota [None req-b286114f-8c4c-4802-8501-abbbb8e65ff7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Getting quotas for user de1ce4a75440478d957a3a03d41dbffd and project 958d3fd7755a4e0b8419e92a26656e2d. Resources: {'key_pairs'} {{(pid=124845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 18:00:15.817855 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b286114f-8c4c-4802-8501-abbbb8e65ff7 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191937 Jul 20 18:00:15.818508 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 539/1088] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jul 20 18:00:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:00:16.334420 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4180a090-2225-47a6-be87-3914c5ce2edc tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:16.335037 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4180a090-2225-47a6-be87-3914c5ce2edc tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:16.341533 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4180a090-2225-47a6-be87-3914c5ce2edc tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:16.341986 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4180a090-2225-47a6-be87-3914c5ce2edc tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:16.342761 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4180a090-2225-47a6-be87-3914c5ce2edc tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:16.343202 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4180a090-2225-47a6-be87-3914c5ce2edc tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:16.527236 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-4180a090-2225-47a6-be87-3914c5ce2edc tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:16.534125 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4180a090-2225-47a6-be87-3914c5ce2edc tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1452 microversion: 2.1 time: 0.202976 Jul 20 18:00:16.534837 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 550/1089] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:16 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:16.558501 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ed12ef9d-f601-43d4-abd2-b771953f1ede tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:16.559527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ed12ef9d-f601-43d4-abd2-b771953f1ede tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:16.568682 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed12ef9d-f601-43d4-abd2-b771953f1ede tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:16.568682 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed12ef9d-f601-43d4-abd2-b771953f1ede tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:16.568682 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed12ef9d-f601-43d4-abd2-b771953f1ede tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:16.569011 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ed12ef9d-f601-43d4-abd2-b771953f1ede tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:16.725019 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ed12ef9d-f601-43d4-abd2-b771953f1ede tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:16.732520 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ed12ef9d-f601-43d4-abd2-b771953f1ede tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1452 microversion: 2.1 time: 0.181569 Jul 20 18:00:16.732973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 540/1090] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:16 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:18.811836 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-49759845", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5841bc30-6bad-4d17-a6eb-d05a9884e54b"}], "security_groups": [{"name": "tempest-securitygroup--1999873892"}], "key_name": "tempest-keypair-110631631", "user_data": "}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:18.920991 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] validate_networks() for [('5841bc30-6bad-4d17-a6eb-d05a9884e54b', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 18:00:19.371304 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-ff6af59a-1fa8-4235-9028-8a71c2438519 req-14c7c5dc-2336-4116-b04b-1ddf505f9277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe7e7c5-28ce-436c-bdf2-486e17cd8928", "tag": "15690f10-2ae5-4510-a8e1-752ef9c31ba6"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:19.379640 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-ff6af59a-1fa8-4235-9028-8a71c2438519 req-14c7c5dc-2336-4116-b04b-1ddf505f9277 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:19.380079 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-ff6af59a-1fa8-4235-9028-8a71c2438519 req-14c7c5dc-2336-4116-b04b-1ddf505f9277 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:19.391689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-ff6af59a-1fa8-4235-9028-8a71c2438519 req-14c7c5dc-2336-4116-b04b-1ddf505f9277 service nova] Creating event network-changed:15690f10-2ae5-4510-a8e1-752ef9c31ba6 for instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 on hv-cinder-84984 Jul 20 18:00:19.398110 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-ff6af59a-1fa8-4235-9028-8a71c2438519 req-14c7c5dc-2336-4116-b04b-1ddf505f9277 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168941 Jul 20 18:00:19.398706 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 541/1091] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 18:00:19.874362 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 18:00:19.874852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 18:00:19.875362 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 18:00:19.875715 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 18:00:19.876251 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 18:00:19.878991 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:19.888276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:19.888687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:19.889671 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:19.889986 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:19.907940 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Getting quotas for project 958d3fd7755a4e0b8419e92a26656e2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 18:00:19.912837 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Getting quotas for user de1ce4a75440478d957a3a03d41dbffd and project 958d3fd7755a4e0b8419e92a26656e2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 18:00:19.926603 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 18:00:19.929338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 18:00:20.069701 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6c81c174-1600-407a-bd85-23e101410921 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.262491 Jul 20 18:00:20.076399 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 551/1092] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 18:00:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 18:00:20.082209 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-11910f0d-d0ec-41c1-a115-2f768d1364be tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:20.083453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-11910f0d-d0ec-41c1-a115-2f768d1364be tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:20.237547 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-11910f0d-d0ec-41c1-a115-2f768d1364be tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:20.244949 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-11910f0d-d0ec-41c1-a115-2f768d1364be tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1235 microversion: 2.1 time: 0.167307 Jul 20 18:00:20.245704 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 542/1093] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:20 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1235 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:21.263226 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-df9b94ed-8951-4a1b-aacd-6bdf4599a6bf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:21.263844 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-df9b94ed-8951-4a1b-aacd-6bdf4599a6bf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:21.270535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-df9b94ed-8951-4a1b-aacd-6bdf4599a6bf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:21.270979 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-df9b94ed-8951-4a1b-aacd-6bdf4599a6bf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:21.271736 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-df9b94ed-8951-4a1b-aacd-6bdf4599a6bf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:21.272170 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-df9b94ed-8951-4a1b-aacd-6bdf4599a6bf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:21.333579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-df9b94ed-8951-4a1b-aacd-6bdf4599a6bf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:21.341239 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-df9b94ed-8951-4a1b-aacd-6bdf4599a6bf tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1239 microversion: 2.1 time: 0.082445 Jul 20 18:00:21.345912 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 552/1094] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:21 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:22.358935 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-f2be78de-611b-4d95-ad48-dcecd21c20b6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:22.359488 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-f2be78de-611b-4d95-ad48-dcecd21c20b6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:22.362517 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:22.368419 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2be78de-611b-4d95-ad48-dcecd21c20b6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:22.368876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2be78de-611b-4d95-ad48-dcecd21c20b6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:22.369638 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2be78de-611b-4d95-ad48-dcecd21c20b6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:22.370077 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-f2be78de-611b-4d95-ad48-dcecd21c20b6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:22.434453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-f2be78de-611b-4d95-ad48-dcecd21c20b6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:22.442452 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-f2be78de-611b-4d95-ad48-dcecd21c20b6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1287 microversion: 2.1 time: 0.087478 Jul 20 18:00:22.443225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 543/1095] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:22 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 18:00:23.460275 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-74b395ca-ff41-4948-b964-ebfce8a568a4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:23.461080 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-74b395ca-ff41-4948-b964-ebfce8a568a4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:23.467996 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-74b395ca-ff41-4948-b964-ebfce8a568a4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:23.468458 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-74b395ca-ff41-4948-b964-ebfce8a568a4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:23.469285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-74b395ca-ff41-4948-b964-ebfce8a568a4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:23.469716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-74b395ca-ff41-4948-b964-ebfce8a568a4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:23.665001 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-74b395ca-ff41-4948-b964-ebfce8a568a4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:23.672568 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-74b395ca-ff41-4948-b964-ebfce8a568a4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1361 microversion: 2.1 time: 0.217029 Jul 20 18:00:23.673127 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 553/1096] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:23 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 18:00:24.494413 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-1ae2da28-9695-404d-bb3e-58fe87855090 req-7d0c5ae4-fb99-4a9b-b9e9-44e9af586bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b658db00-307c-4e6e-b94d-0cd60875038f", "tag": "e155550f-00aa-474b-aaa2-a8d71caff4b2"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:24.505717 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-1ae2da28-9695-404d-bb3e-58fe87855090 req-7d0c5ae4-fb99-4a9b-b9e9-44e9af586bb0 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:24.506178 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-1ae2da28-9695-404d-bb3e-58fe87855090 req-7d0c5ae4-fb99-4a9b-b9e9-44e9af586bb0 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:24.522939 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-1ae2da28-9695-404d-bb3e-58fe87855090 req-7d0c5ae4-fb99-4a9b-b9e9-44e9af586bb0 service nova] Creating event network-changed:e155550f-00aa-474b-aaa2-a8d71caff4b2 for instance b658db00-307c-4e6e-b94d-0cd60875038f on hv-cinder-84984 Jul 20 18:00:24.528407 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-1ae2da28-9695-404d-bb3e-58fe87855090 req-7d0c5ae4-fb99-4a9b-b9e9-44e9af586bb0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040438 Jul 20 18:00:24.529030 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 544/1097] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:00:24.690057 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-7f7a1497-2444-4621-ab33-03bb6dbde84e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:24.690752 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-7f7a1497-2444-4621-ab33-03bb6dbde84e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:24.697741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f7a1497-2444-4621-ab33-03bb6dbde84e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:24.698185 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f7a1497-2444-4621-ab33-03bb6dbde84e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:24.698998 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f7a1497-2444-4621-ab33-03bb6dbde84e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:24.699426 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-7f7a1497-2444-4621-ab33-03bb6dbde84e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:24.903540 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-7f7a1497-2444-4621-ab33-03bb6dbde84e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:24.911074 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-7f7a1497-2444-4621-ab33-03bb6dbde84e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1361 microversion: 2.1 time: 0.224888 Jul 20 18:00:24.911642 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 554/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:24 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:25.928225 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0e28e58f-41b1-49cd-b948-627987d796bb tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:25.928965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0e28e58f-41b1-49cd-b948-627987d796bb tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:25.936096 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e28e58f-41b1-49cd-b948-627987d796bb tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:25.936569 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e28e58f-41b1-49cd-b948-627987d796bb tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:25.937324 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e28e58f-41b1-49cd-b948-627987d796bb tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:25.937757 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0e28e58f-41b1-49cd-b948-627987d796bb tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:26.068977 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0e28e58f-41b1-49cd-b948-627987d796bb tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:26.076670 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0e28e58f-41b1-49cd-b948-627987d796bb tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1361 microversion: 2.1 time: 0.152568 Jul 20 18:00:26.077234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 545/1099] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:25 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:27.094064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-81e50e2f-ec05-4928-ad27-50ebe45e294f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:27.094804 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-81e50e2f-ec05-4928-ad27-50ebe45e294f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:27.102034 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81e50e2f-ec05-4928-ad27-50ebe45e294f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:27.102488 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81e50e2f-ec05-4928-ad27-50ebe45e294f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:27.103266 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81e50e2f-ec05-4928-ad27-50ebe45e294f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:27.103723 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-81e50e2f-ec05-4928-ad27-50ebe45e294f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:27.236910 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-81e50e2f-ec05-4928-ad27-50ebe45e294f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:27.244526 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-81e50e2f-ec05-4928-ad27-50ebe45e294f tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1361 microversion: 2.1 time: 0.154431 Jul 20 18:00:27.245354 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 555/1100] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:27 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:28.262015 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aafda596-6095-4d4c-b913-9e1dac5b46f0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:28.262762 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-aafda596-6095-4d4c-b913-9e1dac5b46f0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:28.269968 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aafda596-6095-4d4c-b913-9e1dac5b46f0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:28.270480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aafda596-6095-4d4c-b913-9e1dac5b46f0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:28.271309 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aafda596-6095-4d4c-b913-9e1dac5b46f0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:28.271801 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aafda596-6095-4d4c-b913-9e1dac5b46f0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:28.402278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aafda596-6095-4d4c-b913-9e1dac5b46f0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:28.409701 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-aafda596-6095-4d4c-b913-9e1dac5b46f0 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1361 microversion: 2.1 time: 0.151799 Jul 20 18:00:28.410262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 546/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:28 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:29.297758 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-6f850604-7369-4307-89e8-d2108ca7b9fb req-4deb2be6-e404-47d1-bd95-ded7744059be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b658db00-307c-4e6e-b94d-0cd60875038f", "name": "network-vif-plugged", "status": "completed", "tag": "e155550f-00aa-474b-aaa2-a8d71caff4b2"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:29.305833 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-6f850604-7369-4307-89e8-d2108ca7b9fb req-4deb2be6-e404-47d1-bd95-ded7744059be service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:29.306273 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-6f850604-7369-4307-89e8-d2108ca7b9fb req-4deb2be6-e404-47d1-bd95-ded7744059be service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:29.317533 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-6f850604-7369-4307-89e8-d2108ca7b9fb req-4deb2be6-e404-47d1-bd95-ded7744059be service nova] Creating event network-vif-plugged:e155550f-00aa-474b-aaa2-a8d71caff4b2 for instance b658db00-307c-4e6e-b94d-0cd60875038f on hv-cinder-84984 Jul 20 18:00:29.323070 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-6f850604-7369-4307-89e8-d2108ca7b9fb req-4deb2be6-e404-47d1-bd95-ded7744059be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089461 Jul 20 18:00:29.323613 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 556/1102] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:00:29.426301 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-843a4935-e0d3-4fa9-b7d5-2c0a03c0a099 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:29.427242 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-843a4935-e0d3-4fa9-b7d5-2c0a03c0a099 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:29.433372 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-843a4935-e0d3-4fa9-b7d5-2c0a03c0a099 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:29.433836 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-843a4935-e0d3-4fa9-b7d5-2c0a03c0a099 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:29.434578 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-843a4935-e0d3-4fa9-b7d5-2c0a03c0a099 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:29.435011 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-843a4935-e0d3-4fa9-b7d5-2c0a03c0a099 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:29.571750 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-843a4935-e0d3-4fa9-b7d5-2c0a03c0a099 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:29.579215 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-843a4935-e0d3-4fa9-b7d5-2c0a03c0a099 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1361 microversion: 2.1 time: 0.156838 Jul 20 18:00:29.579786 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 547/1103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:29 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:30.593385 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:30.594215 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=6 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:30.598753 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-51a14546-94f5-4659-a10f-c4f617507555 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:30.601215 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-51a14546-94f5-4659-a10f-c4f617507555 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:30.606879 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-51a14546-94f5-4659-a10f-c4f617507555 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:30.607333 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-51a14546-94f5-4659-a10f-c4f617507555 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:30.608098 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-51a14546-94f5-4659-a10f-c4f617507555 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:30.608564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-51a14546-94f5-4659-a10f-c4f617507555 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:30.749882 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-51a14546-94f5-4659-a10f-c4f617507555 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:30.757001 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-51a14546-94f5-4659-a10f-c4f617507555 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1361 microversion: 2.1 time: 0.164666 Jul 20 18:00:30.757570 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 557/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:30 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:31.773581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7ab633c1-173c-4720-aa2a-69376a867be5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:31.774234 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7ab633c1-173c-4720-aa2a-69376a867be5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:31.776137 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=6 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:31.781490 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ab633c1-173c-4720-aa2a-69376a867be5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:31.781942 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ab633c1-173c-4720-aa2a-69376a867be5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:31.782705 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ab633c1-173c-4720-aa2a-69376a867be5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:31.783629 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-7ab633c1-173c-4720-aa2a-69376a867be5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:31.914650 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7ab633c1-173c-4720-aa2a-69376a867be5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:00:31.922052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7ab633c1-173c-4720-aa2a-69376a867be5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1548 microversion: 2.1 time: 0.152354 Jul 20 18:00:31.927818 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 548/1105] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:00:31 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:00:31.938016 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6857f3cc-d728-4961-aca4-9517aec7dbba tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:00:31.938505 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6857f3cc-d728-4961-aca4-9517aec7dbba tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:00:31.945025 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6857f3cc-d728-4961-aca4-9517aec7dbba tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:31.945474 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6857f3cc-d728-4961-aca4-9517aec7dbba tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:31.946492 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6857f3cc-d728-4961-aca4-9517aec7dbba tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:31.946931 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6857f3cc-d728-4961-aca4-9517aec7dbba tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:32.025964 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6857f3cc-d728-4961-aca4-9517aec7dbba tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091766 Jul 20 18:00:32.026562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 558/1106] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jul 20 18:00:31 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 18:00:33.634590 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-291be7f9-00cc-4e4e-9a1a-bba60b18cb7e req-278da53f-c304-4d1a-bdca-2a9af6448332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b658db00-307c-4e6e-b94d-0cd60875038f", "tag": "e155550f-00aa-474b-aaa2-a8d71caff4b2"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:00:33.653282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-291be7f9-00cc-4e4e-9a1a-bba60b18cb7e req-278da53f-c304-4d1a-bdca-2a9af6448332 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:00:33.653282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-291be7f9-00cc-4e4e-9a1a-bba60b18cb7e req-278da53f-c304-4d1a-bdca-2a9af6448332 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:00:33.659106 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-291be7f9-00cc-4e4e-9a1a-bba60b18cb7e req-278da53f-c304-4d1a-bdca-2a9af6448332 service nova] Creating event network-changed:e155550f-00aa-474b-aaa2-a8d71caff4b2 for instance b658db00-307c-4e6e-b94d-0cd60875038f on hv-cinder-84984 Jul 20 18:00:33.664333 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-291be7f9-00cc-4e4e-9a1a-bba60b18cb7e req-278da53f-c304-4d1a-bdca-2a9af6448332 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033513 Jul 20 18:00:33.665171 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 549/1107] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:09.458782 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:09.459656 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=82 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:09.463803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-0d1b8bb5-fd02-45d5-be8c-c1ebcca1b433 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:09.464327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-0d1b8bb5-fd02-45d5-be8c-c1ebcca1b433 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:09.470813 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0d1b8bb5-fd02-45d5-be8c-c1ebcca1b433 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:09.471336 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0d1b8bb5-fd02-45d5-be8c-c1ebcca1b433 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:09.472026 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0d1b8bb5-fd02-45d5-be8c-c1ebcca1b433 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:09.472479 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-0d1b8bb5-fd02-45d5-be8c-c1ebcca1b433 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:09.498292 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-0d1b8bb5-fd02-45d5-be8c-c1ebcca1b433 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/ips" status: 200 len: 147 microversion: 2.1 time: 0.040888 Jul 20 18:01:09.498867 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 559/1108] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jul 20 18:01:09 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:11.288898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=13 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:11.289649 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=64 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:11.293941 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-957d0985-1971-44f1-b29a-fe5b1ed93d13 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43310cd3-3a6d-4321-9357-af79ff42f141"}} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:01:11.295077 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-957d0985-1971-44f1-b29a-fe5b1ed93d13 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:11.301088 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-957d0985-1971-44f1-b29a-fe5b1ed93d13 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:11.302867 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-957d0985-1971-44f1-b29a-fe5b1ed93d13 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:11.302867 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-957d0985-1971-44f1-b29a-fe5b1ed93d13 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:11.302867 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-957d0985-1971-44f1-b29a-fe5b1ed93d13 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:12.178692 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-957d0985-1971-44f1-b29a-fe5b1ed93d13 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891147 Jul 20 18:01:12.179369 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 550/1109] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 18:01:11 2022] POST /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:20.722952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2f183073-30c2-45c4-9e49-ea665bd34c9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:20.723918 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2f183073-30c2-45c4-9e49-ea665bd34c9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:20.731115 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2f183073-30c2-45c4-9e49-ea665bd34c9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:20.731561 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2f183073-30c2-45c4-9e49-ea665bd34c9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:20.732319 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2f183073-30c2-45c4-9e49-ea665bd34c9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:20.732783 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2f183073-30c2-45c4-9e49-ea665bd34c9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:20.762916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2f183073-30c2-45c4-9e49-ea665bd34c9c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Jul 20 18:01:20.763457 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 560/1110] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 18:01:20 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:20.774403 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b69c7177-61f0-4235-a06b-365e592853dc tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:20.774994 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b69c7177-61f0-4235-a06b-365e592853dc tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:20.781213 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b69c7177-61f0-4235-a06b-365e592853dc tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:20.781666 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b69c7177-61f0-4235-a06b-365e592853dc tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:20.782462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b69c7177-61f0-4235-a06b-365e592853dc tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:20.782909 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b69c7177-61f0-4235-a06b-365e592853dc tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:20.811398 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b69c7177-61f0-4235-a06b-365e592853dc tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/43310cd3-3a6d-4321-9357-af79ff42f141" status: 200 len: 194 microversion: 2.1 time: 0.041690 Jul 20 18:01:20.811980 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 551/1111] 10.222.0.42 () {58 vars in 1412 bytes} [Wed Jul 20 18:01:20 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/43310cd3-3a6d-4321-9357-af79ff42f141 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:22.443131 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9064bfeb-696c-410d-9398-1d3009a895b4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2662d95c-135b-4bc7-aaab-65eb3a02fe3d"}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:01:22.444180 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9064bfeb-696c-410d-9398-1d3009a895b4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:22.451103 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9064bfeb-696c-410d-9398-1d3009a895b4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:22.451546 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9064bfeb-696c-410d-9398-1d3009a895b4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:22.452342 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9064bfeb-696c-410d-9398-1d3009a895b4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:22.452889 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9064bfeb-696c-410d-9398-1d3009a895b4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:23.275860 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9064bfeb-696c-410d-9398-1d3009a895b4 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "POST /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.836339 Jul 20 18:01:23.276694 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 561/1112] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jul 20 18:01:22 2022] POST /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:31.822370 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4be6ea2e-9ecf-4fe4-93f5-d2bc14f1fc2d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:31.823360 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4be6ea2e-9ecf-4fe4-93f5-d2bc14f1fc2d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:31.825865 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=4 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:31.826567 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:31.832399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4be6ea2e-9ecf-4fe4-93f5-d2bc14f1fc2d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:31.832399 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4be6ea2e-9ecf-4fe4-93f5-d2bc14f1fc2d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:31.832638 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4be6ea2e-9ecf-4fe4-93f5-d2bc14f1fc2d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:31.832901 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-4be6ea2e-9ecf-4fe4-93f5-d2bc14f1fc2d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:31.862716 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4be6ea2e-9ecf-4fe4-93f5-d2bc14f1fc2d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044514 Jul 20 18:01:31.863268 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 552/1113] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 18:01:31 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:32.010572 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-184a3d52-d0cf-45a8-8baf-309ef077600a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:32.011145 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-184a3d52-d0cf-45a8-8baf-309ef077600a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:32.017338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-184a3d52-d0cf-45a8-8baf-309ef077600a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:32.017792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-184a3d52-d0cf-45a8-8baf-309ef077600a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:32.018548 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-184a3d52-d0cf-45a8-8baf-309ef077600a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:32.018989 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-184a3d52-d0cf-45a8-8baf-309ef077600a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:32.046839 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-184a3d52-d0cf-45a8-8baf-309ef077600a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/43310cd3-3a6d-4321-9357-af79ff42f141" status: 200 len: 194 microversion: 2.1 time: 0.041273 Jul 20 18:01:32.047439 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 562/1114] 10.222.0.42 () {58 vars in 1412 bytes} [Wed Jul 20 18:01:32 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/43310cd3-3a6d-4321-9357-af79ff42f141 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:32.057620 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ba7d757e-cd8d-4e24-8de3-f3b9015b0b9d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:32.058135 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ba7d757e-cd8d-4e24-8de3-f3b9015b0b9d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:32.065152 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba7d757e-cd8d-4e24-8de3-f3b9015b0b9d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:32.065597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba7d757e-cd8d-4e24-8de3-f3b9015b0b9d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:32.066352 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba7d757e-cd8d-4e24-8de3-f3b9015b0b9d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:32.066785 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ba7d757e-cd8d-4e24-8de3-f3b9015b0b9d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:32.145606 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-ba7d757e-cd8d-4e24-8de3-f3b9015b0b9d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lazy-loading 'services' on Instance uuid b658db00-307c-4e6e-b94d-0cd60875038f {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 18:01:32.379204 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ba7d757e-cd8d-4e24-8de3-f3b9015b0b9d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/43310cd3-3a6d-4321-9357-af79ff42f141" status: 202 len: 0 microversion: 2.1 time: 0.325352 Jul 20 18:01:32.379802 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 553/1115] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 18:01:32 2022] DELETE /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/43310cd3-3a6d-4321-9357-af79ff42f141 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 18:01:34.545801 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-702d94c6-1a95-4720-9143-52b31e09399e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:34.546331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-702d94c6-1a95-4720-9143-52b31e09399e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:34.553276 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-702d94c6-1a95-4720-9143-52b31e09399e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:34.553750 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-702d94c6-1a95-4720-9143-52b31e09399e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:34.554637 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-702d94c6-1a95-4720-9143-52b31e09399e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:34.555110 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-702d94c6-1a95-4720-9143-52b31e09399e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:34.586607 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-702d94c6-1a95-4720-9143-52b31e09399e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/2662d95c-135b-4bc7-aaab-65eb3a02fe3d" status: 200 len: 194 microversion: 2.1 time: 0.045056 Jul 20 18:01:34.587256 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 563/1116] 10.222.0.42 () {58 vars in 1412 bytes} [Wed Jul 20 18:01:34 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/2662d95c-135b-4bc7-aaab-65eb3a02fe3d => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:34.598571 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b0a21d88-a613-491d-88d2-22bab5f9fc79 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:34.599149 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b0a21d88-a613-491d-88d2-22bab5f9fc79 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:34.605627 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b0a21d88-a613-491d-88d2-22bab5f9fc79 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:34.606081 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b0a21d88-a613-491d-88d2-22bab5f9fc79 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:34.606857 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b0a21d88-a613-491d-88d2-22bab5f9fc79 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:34.607296 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b0a21d88-a613-491d-88d2-22bab5f9fc79 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:34.688287 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-b0a21d88-a613-491d-88d2-22bab5f9fc79 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lazy-loading 'services' on Instance uuid b658db00-307c-4e6e-b94d-0cd60875038f {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 18:01:34.927660 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b0a21d88-a613-491d-88d2-22bab5f9fc79 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/2662d95c-135b-4bc7-aaab-65eb3a02fe3d" status: 202 len: 0 microversion: 2.1 time: 0.334316 Jul 20 18:01:34.928815 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 554/1117] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jul 20 18:01:34 2022] DELETE /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments/2662d95c-135b-4bc7-aaab-65eb3a02fe3d => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 18:01:37.139985 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-4fb85af6-8c35-4d70-bd84-cb154ca2cf69 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:37.141045 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-4fb85af6-8c35-4d70-bd84-cb154ca2cf69 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:37.148534 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fb85af6-8c35-4d70-bd84-cb154ca2cf69 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:37.149015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fb85af6-8c35-4d70-bd84-cb154ca2cf69 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:37.149848 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fb85af6-8c35-4d70-bd84-cb154ca2cf69 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:37.150317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-4fb85af6-8c35-4d70-bd84-cb154ca2cf69 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:37.179793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-4fb85af6-8c35-4d70-bd84-cb154ca2cf69 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044110 Jul 20 18:01:37.180337 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 564/1118] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 18:01:37 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 18:01:37.286311 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a1e522aa-2070-4531-bd0b-3c0e042f49e6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:37.287330 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a1e522aa-2070-4531-bd0b-3c0e042f49e6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:37.300687 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a1e522aa-2070-4531-bd0b-3c0e042f49e6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:37.300687 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a1e522aa-2070-4531-bd0b-3c0e042f49e6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:37.300687 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a1e522aa-2070-4531-bd0b-3c0e042f49e6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:37.300687 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a1e522aa-2070-4531-bd0b-3c0e042f49e6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:37.324239 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a1e522aa-2070-4531-bd0b-3c0e042f49e6 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042814 Jul 20 18:01:37.324822 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 555/1119] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jul 20 18:01:37 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 18:01:37.381952 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-76baa46f-07fa-4572-b4fc-fe7d46bb2e4c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:37.382317 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-76baa46f-07fa-4572-b4fc-fe7d46bb2e4c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:37.388241 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-76baa46f-07fa-4572-b4fc-fe7d46bb2e4c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:37.388716 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-76baa46f-07fa-4572-b4fc-fe7d46bb2e4c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:37.389554 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-76baa46f-07fa-4572-b4fc-fe7d46bb2e4c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:37.389990 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-76baa46f-07fa-4572-b4fc-fe7d46bb2e4c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:37.414892 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-76baa46f-07fa-4572-b4fc-fe7d46bb2e4c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 18:01:37.774320 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-76baa46f-07fa-4572-b4fc-fe7d46bb2e4c tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 204 len: 0 microversion: 2.1 time: 0.396549 Jul 20 18:01:37.774919 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 565/1120] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 18:01:37 2022] DELETE /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 18:01:37.783196 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-aba10175-27e4-4931-9049-a6a613d4de8d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:37.783816 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-aba10175-27e4-4931-9049-a6a613d4de8d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:37.789791 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aba10175-27e4-4931-9049-a6a613d4de8d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:37.790242 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aba10175-27e4-4931-9049-a6a613d4de8d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:37.791008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aba10175-27e4-4931-9049-a6a613d4de8d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:37.791448 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-aba10175-27e4-4931-9049-a6a613d4de8d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:37.934391 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-aba10175-27e4-4931-9049-a6a613d4de8d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:01:37.942453 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-aba10175-27e4-4931-9049-a6a613d4de8d tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1673 microversion: 2.1 time: 0.163103 Jul 20 18:01:37.943020 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 556/1121] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:01:37 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:01:38.961022 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bd11e253-25c1-488a-8c7f-24445991541a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:38.961724 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-bd11e253-25c1-488a-8c7f-24445991541a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:38.968263 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bd11e253-25c1-488a-8c7f-24445991541a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:38.968744 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bd11e253-25c1-488a-8c7f-24445991541a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:38.969506 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bd11e253-25c1-488a-8c7f-24445991541a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:38.969939 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bd11e253-25c1-488a-8c7f-24445991541a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:39.104033 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-bd11e253-25c1-488a-8c7f-24445991541a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:01:39.111797 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-bd11e253-25c1-488a-8c7f-24445991541a tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1673 microversion: 2.1 time: 0.155200 Jul 20 18:01:39.112370 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 566/1122] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:01:38 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:01:40.129233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6c9e13b9-ec77-4f39-a7c7-b96bc67d4288 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:40.129854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6c9e13b9-ec77-4f39-a7c7-b96bc67d4288 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:40.136455 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c9e13b9-ec77-4f39-a7c7-b96bc67d4288 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:40.136920 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c9e13b9-ec77-4f39-a7c7-b96bc67d4288 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:40.137696 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c9e13b9-ec77-4f39-a7c7-b96bc67d4288 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:40.138138 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c9e13b9-ec77-4f39-a7c7-b96bc67d4288 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:40.391824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-6c9e13b9-ec77-4f39-a7c7-b96bc67d4288 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:01:40.399385 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6c9e13b9-ec77-4f39-a7c7-b96bc67d4288 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1673 microversion: 2.1 time: 0.274166 Jul 20 18:01:40.400107 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 557/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:01:40 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1673 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:01:40.920449 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-96ac1423-daf5-460a-9f50-33b3680aba47 req-8483bbb8-5e19-49f3-848d-81be7a9b7fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b658db00-307c-4e6e-b94d-0cd60875038f", "name": "network-vif-deleted", "tag": "e155550f-00aa-474b-aaa2-a8d71caff4b2"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:01:40.929415 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-96ac1423-daf5-460a-9f50-33b3680aba47 req-8483bbb8-5e19-49f3-848d-81be7a9b7fe1 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:40.929974 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-96ac1423-daf5-460a-9f50-33b3680aba47 req-8483bbb8-5e19-49f3-848d-81be7a9b7fe1 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:40.943301 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-96ac1423-daf5-460a-9f50-33b3680aba47 req-8483bbb8-5e19-49f3-848d-81be7a9b7fe1 service nova] Creating event network-vif-deleted:e155550f-00aa-474b-aaa2-a8d71caff4b2 for instance b658db00-307c-4e6e-b94d-0cd60875038f on hv-cinder-84984 Jul 20 18:01:40.949054 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-96ac1423-daf5-460a-9f50-33b3680aba47 req-8483bbb8-5e19-49f3-848d-81be7a9b7fe1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 Jul 20 18:01:40.949699 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 567/1124] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:01:41.417210 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:41.417824 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:41.424642 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:41.425090 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:41.425859 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:41.426293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:41.460738 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:41.461193 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:41.461636 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lazy-loading 'fault' on Instance uuid b658db00-307c-4e6e-b94d-0cd60875038f {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 18:01:41.502913 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1ce4a75440478d957a3a03d41dbffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958d3fd7755a4e0b8419e92a26656e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:01:41.510791 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-d236b13f-df3d-4693-a906-ce93f8cdde92 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 200 len: 1325 microversion: 2.1 time: 0.097346 Jul 20 18:01:41.511359 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 558/1125] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:01:41 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 1325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:01:42.534208 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:42.540454 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:42.541999 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:42.542459 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:42.543226 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:42.543663 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:42.556734 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] HTTP exception thrown: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Request method failure captured: Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f HTTP/1.1 Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EH5xNuxVADOjDa6x7QFfff0OztZOmMq_8m-Ni7WgjddodUU4No1qJRuOeZ4pLyHbK_MmU-frhMNN-t5SSp0BIqTLGoNOFF71Mm-G88X3pUbdFPD14FYSlbGT_XSQEfu44C4UpLrCOq6wUE4dw1tGkEAKA5zyu9yeIF8CFg0TuZHMAU Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 18:01:42.558346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/958d3fd7755a4e0b8419e92a26656e2d"}]}] Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: de1ce4a75440478d957a3a03d41dbffd Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:42.560021 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'b658db00-307c-4e6e-b94d-0cd60875038f'} Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:01:42.561146 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:42.562785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:42.564298 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Returning 404 to user: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:01:42.564298 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-205288c4-ac39-49ff-bfb7-d17032a35210 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 404 len: 111 microversion: 2.1 time: 0.029741 Jul 20 18:01:42.564298 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 568/1126] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:01:42 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:01:42.568911 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-47000bb9-af95-4a2d-973a-99458211814b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '.version_select at 0x7f7d3df5e550>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:42.660970 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-47000bb9-af95-4a2d-973a-99458211814b tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-110631631" status: 202 len: 0 microversion: 2.1 time: 0.096291 Jul 20 18:01:42.661538 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 559/1127] 10.222.0.42 () {58 vars in 1217 bytes} [Wed Jul 20 18:01:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-110631631 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 18:01:46.050056 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:46.050541 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:46.057048 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:46.057517 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:46.058308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:46.058738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:46.072534 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] HTTP exception thrown: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Request method failure captured: Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f HTTP/1.1 Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EH5xNuxVADOjDa6x7QFfff0OztZOmMq_8m-Ni7WgjddodUU4No1qJRuOeZ4pLyHbK_MmU-frhMNN-t5SSp0BIqTLGoNOFF71Mm-G88X3pUbdFPD14FYSlbGT_XSQEfu44C4UpLrCOq6wUE4dw1tGkEAKA5zyu9yeIF8CFg0TuZHMAU Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 18:01:46.074051 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/958d3fd7755a4e0b8419e92a26656e2d"}]}] Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: de1ce4a75440478d957a3a03d41dbffd Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.078890 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': 'b658db00-307c-4e6e-b94d-0cd60875038f'} Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:01:46.079667 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.081489 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.082728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Returning 404 to user: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:01:46.082728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-eb7e3a43-2aa7-49a0-bacd-dd76139d7fb5 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 404 len: 111 microversion: 2.1 time: 0.029239 Jul 20 18:01:46.082728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 569/1128] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 18:01:46 2022] DELETE /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:01:46.085025 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:46.085667 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: b658db00-307c-4e6e-b94d-0cd60875038f] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:46.092624 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:46.093085 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:46.093853 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:46.094292 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:46.107986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] HTTP exception thrown: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Request method failure captured: Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f HTTP/1.1 Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EH5xNuxVADOjDa6x7QFfff0OztZOmMq_8m-Ni7WgjddodUU4No1qJRuOeZ4pLyHbK_MmU-frhMNN-t5SSp0BIqTLGoNOFF71Mm-G88X3pUbdFPD14FYSlbGT_XSQEfu44C4UpLrCOq6wUE4dw1tGkEAKA5zyu9yeIF8CFg0TuZHMAU Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 18:01:46.109689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/958d3fd7755a4e0b8419e92a26656e2d"}]}] Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: de1ce4a75440478d957a3a03d41dbffd Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.111084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': 'b658db00-307c-4e6e-b94d-0cd60875038f'} Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:01:46.112014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. Jul 20 18:01:46.113619 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:46.115122 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Returning 404 to user: Instance b658db00-307c-4e6e-b94d-0cd60875038f could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:01:46.115122 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-65da2fa8-61c1-4202-8f92-48a786e29a14 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f" status: 404 len: 111 microversion: 2.1 time: 0.031105 Jul 20 18:01:46.115122 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 560/1129] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:01:46 2022] GET /compute/v2.1/servers/b658db00-307c-4e6e-b94d-0cd60875038f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:01:47.443509 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:47.444014 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:47.450835 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:47.451411 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:47.452211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:47.452689 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:47.466394 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] HTTP exception thrown: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Request method failure captured: Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: DELETE /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 HTTP/1.1 Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EH5xNuxVADOjDa6x7QFfff0OztZOmMq_8m-Ni7WgjddodUU4No1qJRuOeZ4pLyHbK_MmU-frhMNN-t5SSp0BIqTLGoNOFF71Mm-G88X3pUbdFPD14FYSlbGT_XSQEfu44C4UpLrCOq6wUE4dw1tGkEAKA5zyu9yeIF8CFg0TuZHMAU Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 18:01:47.467933 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/958d3fd7755a4e0b8419e92a26656e2d"}]}] Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: de1ce4a75440478d957a3a03d41dbffd Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.469704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '2b0962b1-c468-4a10-9a82-363f867efe92'} Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:01:47.470626 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.472821 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.474707 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Returning 404 to user: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:01:47.474707 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c47d180b-5a07-42c1-9966-9e2b24398434 tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 404 len: 111 microversion: 2.1 time: 0.029716 Jul 20 18:01:47.474707 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 570/1130] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 18:01:47 2022] DELETE /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:01:47.478329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:01:47.478951 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] [instance: 2b0962b1-c468-4a10-9a82-363f867efe92] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:01:47.485447 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:47.485897 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:47.486682 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:47.487120 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:47.500261 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] HTTP exception thrown: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Request method failure captured: Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 HTTP/1.1 Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EH5xNuxVADOjDa6x7QFfff0OztZOmMq_8m-Ni7WgjddodUU4No1qJRuOeZ4pLyHbK_MmU-frhMNN-t5SSp0BIqTLGoNOFF71Mm-G88X3pUbdFPD14FYSlbGT_XSQEfu44C4UpLrCOq6wUE4dw1tGkEAKA5zyu9yeIF8CFg0TuZHMAU Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 18:01:47.501805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/958d3fd7755a4e0b8419e92a26656e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/958d3fd7755a4e0b8419e92a26656e2d"}]}] Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 958d3fd7755a4e0b8419e92a26656e2d Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1950620296 Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: de1ce4a75440478d957a3a03d41dbffd Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-AttachVolumeTestJSON-1950620296-project Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.503566 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '2b0962b1-c468-4a10-9a82-363f867efe92'} Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:01:47.504597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. Jul 20 18:01:47.506109 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:01:47.507611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] Returning 404 to user: Instance 2b0962b1-c468-4a10-9a82-363f867efe92 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:01:47.507611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-34ee1192-f272-466e-862e-077a31305d9e tempest-AttachVolumeTestJSON-1950620296 tempest-AttachVolumeTestJSON-1950620296-project] 10.222.0.42 "GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92" status: 404 len: 111 microversion: 2.1 time: 0.028931 Jul 20 18:01:47.507611 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 561/1131] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:01:47 2022] GET /compute/v2.1/servers/2b0962b1-c468-4a10-9a82-363f867efe92 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:01:58.990793 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-777631173", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-240885777", "security_groups": [{"name": "tempest-secgroup-smoke-1389441536"}], "block_device_mapping_v2": [{"uuid": "e66fb653-0948-4b5f-a10b-51b451800231", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d856af6c-3171-430a-a397-90532200f85e"}]}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:01:58.999417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:59.000083 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:59.119534 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] validate_networks() for [('d856af6c-3171-430a-a397-90532200f85e', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 18:01:59.490786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 18:01:59.491212 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 18:01:59.491686 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 18:01:59.492184 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 18:01:59.492562 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 18:01:59.501385 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:59.501835 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:59.502631 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:01:59.503069 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:01:59.520048 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Getting quotas for project be1213650f38494aa2aeb1aadc7ccbc7. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 18:01:59.524067 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Getting quotas for user 9c95e9df33ad4f819f26fb8b695df7e9 and project be1213650f38494aa2aeb1aadc7ccbc7. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 18:01:59.582266 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 18:01:59.584221 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e66fb653-0948-4b5f-a10b-51b451800231',volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 18:02:00.090734 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cb6e6b17-f972-474c-b542-07253f2feeb2 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.104334 Jul 20 18:02:00.091387 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 571/1132] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 18:01:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 18:02:00.106130 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:00.106130 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:00.356968 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ed75a513-5504-4840-a4f7-b9205dcfce53 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:00.357516 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ed75a513-5504-4840-a4f7-b9205dcfce53 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:00.410255 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ed75a513-5504-4840-a4f7-b9205dcfce53 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:00.416888 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ed75a513-5504-4840-a4f7-b9205dcfce53 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1093 microversion: 2.1 time: 0.318762 Jul 20 18:02:00.417438 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 562/1133] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:00 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1093 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:01.434403 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-37f0d057-d566-4525-988e-36a8bc7447e5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:01.435117 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-37f0d057-d566-4525-988e-36a8bc7447e5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:01.442019 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-37f0d057-d566-4525-988e-36a8bc7447e5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:01.442462 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-37f0d057-d566-4525-988e-36a8bc7447e5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:01.443211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-37f0d057-d566-4525-988e-36a8bc7447e5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:01.443647 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-37f0d057-d566-4525-988e-36a8bc7447e5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:01.504498 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-37f0d057-d566-4525-988e-36a8bc7447e5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:01.513032 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-37f0d057-d566-4525-988e-36a8bc7447e5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1143 microversion: 2.1 time: 0.082952 Jul 20 18:02:01.513594 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 572/1134] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:01 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:02.529898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3091915f-c216-4ecd-82b0-b5e1c4f8de28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:02.530866 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3091915f-c216-4ecd-82b0-b5e1c4f8de28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:02.539332 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3091915f-c216-4ecd-82b0-b5e1c4f8de28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:02.539990 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3091915f-c216-4ecd-82b0-b5e1c4f8de28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:02.541186 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3091915f-c216-4ecd-82b0-b5e1c4f8de28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:02.541776 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3091915f-c216-4ecd-82b0-b5e1c4f8de28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:02.646245 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3091915f-c216-4ecd-82b0-b5e1c4f8de28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:02.656329 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3091915f-c216-4ecd-82b0-b5e1c4f8de28 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1199 microversion: 2.1 time: 0.130430 Jul 20 18:02:02.657737 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 563/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:02 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1199 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:03.676832 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-18c16dbd-749a-4271-ba32-be36129ae0e4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:03.677555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-18c16dbd-749a-4271-ba32-be36129ae0e4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:03.686983 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-18c16dbd-749a-4271-ba32-be36129ae0e4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:03.687535 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-18c16dbd-749a-4271-ba32-be36129ae0e4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:03.688391 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-18c16dbd-749a-4271-ba32-be36129ae0e4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:03.688942 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-18c16dbd-749a-4271-ba32-be36129ae0e4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:03.951584 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-18c16dbd-749a-4271-ba32-be36129ae0e4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:03.959591 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-18c16dbd-749a-4271-ba32-be36129ae0e4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1277 microversion: 2.1 time: 0.287340 Jul 20 18:02:03.960498 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 573/1136] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:03 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1277 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:04.749199 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-1115d4f9-00b5-42a4-8c00-db24fa9fde1c req-cc346241-18c5-4c76-b220-89a55e26654a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80fd9508-a183-4d46-a96e-ab26bebdbc22", "tag": "ae0948b9-34bf-4223-b1ca-440f0354b93f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:02:04.761874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-1115d4f9-00b5-42a4-8c00-db24fa9fde1c req-cc346241-18c5-4c76-b220-89a55e26654a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:04.763782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-1115d4f9-00b5-42a4-8c00-db24fa9fde1c req-cc346241-18c5-4c76-b220-89a55e26654a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:04.782017 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-1115d4f9-00b5-42a4-8c00-db24fa9fde1c req-cc346241-18c5-4c76-b220-89a55e26654a service nova] Creating event network-changed:ae0948b9-34bf-4223-b1ca-440f0354b93f for instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 on hv-cinder-84984 Jul 20 18:02:04.788458 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-1115d4f9-00b5-42a4-8c00-db24fa9fde1c req-cc346241-18c5-4c76-b220-89a55e26654a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044016 Jul 20 18:02:04.789084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 564/1137] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:02:04.977466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ff9f50ce-a5b8-40ba-94c5-5ad103ff1980 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:04.985344 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ff9f50ce-a5b8-40ba-94c5-5ad103ff1980 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:04.993532 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff9f50ce-a5b8-40ba-94c5-5ad103ff1980 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:04.994115 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff9f50ce-a5b8-40ba-94c5-5ad103ff1980 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:04.996070 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff9f50ce-a5b8-40ba-94c5-5ad103ff1980 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:05.000412 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff9f50ce-a5b8-40ba-94c5-5ad103ff1980 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:05.213495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ff9f50ce-a5b8-40ba-94c5-5ad103ff1980 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:05.221574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ff9f50ce-a5b8-40ba-94c5-5ad103ff1980 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.248001 Jul 20 18:02:05.222147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 574/1138] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:04 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:06.239846 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-30d30efa-0764-4465-b4d3-4f2f179b2235 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:06.240657 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-30d30efa-0764-4465-b4d3-4f2f179b2235 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:06.247086 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30d30efa-0764-4465-b4d3-4f2f179b2235 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:06.247536 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30d30efa-0764-4465-b4d3-4f2f179b2235 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:06.248339 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30d30efa-0764-4465-b4d3-4f2f179b2235 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:06.248808 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-30d30efa-0764-4465-b4d3-4f2f179b2235 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:06.384165 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-30d30efa-0764-4465-b4d3-4f2f179b2235 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:06.391715 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-30d30efa-0764-4465-b4d3-4f2f179b2235 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.157090 Jul 20 18:02:06.392307 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 565/1139] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:06 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 18:02:07.409077 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-553a644f-b089-4de7-bbd4-43c804240bd9 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:07.409609 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-553a644f-b089-4de7-bbd4-43c804240bd9 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:07.416011 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-553a644f-b089-4de7-bbd4-43c804240bd9 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:07.416488 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-553a644f-b089-4de7-bbd4-43c804240bd9 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:07.417250 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-553a644f-b089-4de7-bbd4-43c804240bd9 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:07.417685 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-553a644f-b089-4de7-bbd4-43c804240bd9 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:07.550147 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-553a644f-b089-4de7-bbd4-43c804240bd9 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:07.557731 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-553a644f-b089-4de7-bbd4-43c804240bd9 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.153175 Jul 20 18:02:07.558308 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 575/1140] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:07 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:08.575971 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0bfa6f33-daca-4980-8cfe-ca6ac5bd7747 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:08.576618 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0bfa6f33-daca-4980-8cfe-ca6ac5bd7747 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:08.583240 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0bfa6f33-daca-4980-8cfe-ca6ac5bd7747 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:08.583690 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0bfa6f33-daca-4980-8cfe-ca6ac5bd7747 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:08.584484 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0bfa6f33-daca-4980-8cfe-ca6ac5bd7747 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:08.584927 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0bfa6f33-daca-4980-8cfe-ca6ac5bd7747 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:08.769544 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0bfa6f33-daca-4980-8cfe-ca6ac5bd7747 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:08.777375 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0bfa6f33-daca-4980-8cfe-ca6ac5bd7747 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.206054 Jul 20 18:02:08.777980 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 566/1141] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:08 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:09.795579 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f3915de3-e719-456a-b240-bd70366f8399 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:09.796285 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f3915de3-e719-456a-b240-bd70366f8399 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:09.798739 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:09.799467 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=6 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:09.806292 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3915de3-e719-456a-b240-bd70366f8399 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:09.807097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3915de3-e719-456a-b240-bd70366f8399 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:09.808260 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3915de3-e719-456a-b240-bd70366f8399 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:09.808798 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f3915de3-e719-456a-b240-bd70366f8399 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:09.951119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-f3915de3-e719-456a-b240-bd70366f8399 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:09.959084 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f3915de3-e719-456a-b240-bd70366f8399 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.167723 Jul 20 18:02:09.959647 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 576/1142] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:09 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:10.975396 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-95d6717d-f0ec-4630-bfb2-39536c5e18ba tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:10.976018 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-95d6717d-f0ec-4630-bfb2-39536c5e18ba tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:10.979467 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:10.983031 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-95d6717d-f0ec-4630-bfb2-39536c5e18ba tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:10.983492 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-95d6717d-f0ec-4630-bfb2-39536c5e18ba tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:10.984543 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-95d6717d-f0ec-4630-bfb2-39536c5e18ba tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:10.985000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-95d6717d-f0ec-4630-bfb2-39536c5e18ba tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:11.117304 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-95d6717d-f0ec-4630-bfb2-39536c5e18ba tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:11.124793 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-95d6717d-f0ec-4630-bfb2-39536c5e18ba tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.153255 Jul 20 18:02:11.125359 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 567/1143] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:10 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:12.143467 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-9c2b3c1e-501b-43f1-9e8f-d80d6d89fd43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:12.144086 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-9c2b3c1e-501b-43f1-9e8f-d80d6d89fd43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:12.150945 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9c2b3c1e-501b-43f1-9e8f-d80d6d89fd43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:12.151401 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9c2b3c1e-501b-43f1-9e8f-d80d6d89fd43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:12.152185 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9c2b3c1e-501b-43f1-9e8f-d80d6d89fd43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:12.152657 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-9c2b3c1e-501b-43f1-9e8f-d80d6d89fd43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:12.296316 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-9c2b3c1e-501b-43f1-9e8f-d80d6d89fd43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:12.309987 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-9c2b3c1e-501b-43f1-9e8f-d80d6d89fd43 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.168047 Jul 20 18:02:12.309987 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 577/1144] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:12 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:13.325635 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-35833dc5-d684-453c-8c74-b1f35a44fdfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:13.326600 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-35833dc5-d684-453c-8c74-b1f35a44fdfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:13.332898 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-35833dc5-d684-453c-8c74-b1f35a44fdfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:13.333354 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-35833dc5-d684-453c-8c74-b1f35a44fdfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:13.334130 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-35833dc5-d684-453c-8c74-b1f35a44fdfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:13.334567 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-35833dc5-d684-453c-8c74-b1f35a44fdfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:13.466205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-35833dc5-d684-453c-8c74-b1f35a44fdfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:13.474431 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-35833dc5-d684-453c-8c74-b1f35a44fdfa tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.153172 Jul 20 18:02:13.475009 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 568/1145] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:13 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 18:02:14.050042 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-3f24dad1-3019-40e7-a873-9a02652e9734 req-e47b31e3-9fca-4012-8781-cf5a8ecd4351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80fd9508-a183-4d46-a96e-ab26bebdbc22", "name": "network-vif-plugged", "status": "completed", "tag": "ae0948b9-34bf-4223-b1ca-440f0354b93f"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:02:14.058664 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-3f24dad1-3019-40e7-a873-9a02652e9734 req-e47b31e3-9fca-4012-8781-cf5a8ecd4351 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:14.059104 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-3f24dad1-3019-40e7-a873-9a02652e9734 req-e47b31e3-9fca-4012-8781-cf5a8ecd4351 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:14.070189 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-3f24dad1-3019-40e7-a873-9a02652e9734 req-e47b31e3-9fca-4012-8781-cf5a8ecd4351 service nova] Creating event network-vif-plugged:ae0948b9-34bf-4223-b1ca-440f0354b93f for instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 on hv-cinder-84984 Jul 20 18:02:14.075394 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-3f24dad1-3019-40e7-a873-9a02652e9734 req-e47b31e3-9fca-4012-8781-cf5a8ecd4351 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029323 Jul 20 18:02:14.076042 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 578/1146] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:02:14.493133 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-db879f2d-d4d9-464a-90ce-c20611718415 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:14.493689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-db879f2d-d4d9-464a-90ce-c20611718415 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:14.500477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db879f2d-d4d9-464a-90ce-c20611718415 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:14.501009 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db879f2d-d4d9-464a-90ce-c20611718415 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:14.505401 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db879f2d-d4d9-464a-90ce-c20611718415 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:14.505401 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-db879f2d-d4d9-464a-90ce-c20611718415 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:14.669480 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-db879f2d-d4d9-464a-90ce-c20611718415 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:14.677796 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-db879f2d-d4d9-464a-90ce-c20611718415 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.189950 Jul 20 18:02:14.678351 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 569/1147] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:14 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 18:02:15.695410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6e61ae8a-8906-4d89-b8a8-ec1301011688 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:15.696104 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6e61ae8a-8906-4d89-b8a8-ec1301011688 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:15.703360 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6e61ae8a-8906-4d89-b8a8-ec1301011688 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:15.703813 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6e61ae8a-8906-4d89-b8a8-ec1301011688 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:15.705119 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6e61ae8a-8906-4d89-b8a8-ec1301011688 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:15.705553 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6e61ae8a-8906-4d89-b8a8-ec1301011688 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:15.840085 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6e61ae8a-8906-4d89-b8a8-ec1301011688 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:15.848323 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6e61ae8a-8906-4d89-b8a8-ec1301011688 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1265 microversion: 2.1 time: 0.157612 Jul 20 18:02:15.848949 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 579/1148] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:15 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:16.866522 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0b8bb243-0d68-4a12-8df2-9194e37af969 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:16.867139 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0b8bb243-0d68-4a12-8df2-9194e37af969 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:16.873509 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b8bb243-0d68-4a12-8df2-9194e37af969 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:16.873969 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b8bb243-0d68-4a12-8df2-9194e37af969 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:16.874749 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b8bb243-0d68-4a12-8df2-9194e37af969 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:16.875180 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-0b8bb243-0d68-4a12-8df2-9194e37af969 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:17.031367 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0b8bb243-0d68-4a12-8df2-9194e37af969 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:17.039805 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0b8bb243-0d68-4a12-8df2-9194e37af969 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1451 microversion: 2.1 time: 0.177521 Jul 20 18:02:17.040682 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 570/1149] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:16 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:17.060301 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ff6db663-596c-494c-9fae-489f156adbb4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:17.060955 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ff6db663-596c-494c-9fae-489f156adbb4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:17.067354 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff6db663-596c-494c-9fae-489f156adbb4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:17.067806 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff6db663-596c-494c-9fae-489f156adbb4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:17.068595 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff6db663-596c-494c-9fae-489f156adbb4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:17.069032 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ff6db663-596c-494c-9fae-489f156adbb4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:17.233959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ff6db663-596c-494c-9fae-489f156adbb4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:17.241920 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ff6db663-596c-494c-9fae-489f156adbb4 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1451 microversion: 2.1 time: 0.185457 Jul 20 18:02:17.242497 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 580/1150] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:17 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1451 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:19.740580 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-e3e8110a-0535-4399-9269-c664249f5c08 req-ec013e6a-a520-4364-93b3-5a1acdfd8590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80fd9508-a183-4d46-a96e-ab26bebdbc22", "tag": "ae0948b9-34bf-4223-b1ca-440f0354b93f"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:02:19.749740 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e3e8110a-0535-4399-9269-c664249f5c08 req-ec013e6a-a520-4364-93b3-5a1acdfd8590 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:19.750187 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e3e8110a-0535-4399-9269-c664249f5c08 req-ec013e6a-a520-4364-93b3-5a1acdfd8590 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:19.762092 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-e3e8110a-0535-4399-9269-c664249f5c08 req-ec013e6a-a520-4364-93b3-5a1acdfd8590 service nova] Creating event network-changed:ae0948b9-34bf-4223-b1ca-440f0354b93f for instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 on hv-cinder-84984 Jul 20 18:02:19.767577 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-e3e8110a-0535-4399-9269-c664249f5c08 req-ec013e6a-a520-4364-93b3-5a1acdfd8590 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031245 Jul 20 18:02:19.770485 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 571/1151] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 18:02:46.545472 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-273552856", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "networks": [{"uuid": "02579f11-c2b8-4329-9fbc-78c5ebb8e8a3"}]}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:02:46.557300 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:46.558427 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=52 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:46.607227 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] validate_networks() for [('02579f11-c2b8-4329-9fbc-78c5ebb8e8a3', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 18:02:46.963678 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 18:02:46.964096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 18:02:46.964602 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 18:02:46.965015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 18:02:46.965428 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 18:02:46.974161 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:46.974545 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:46.975339 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:46.975782 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:46.992881 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Getting quotas for project 8a09caa450f94f3ea5b9ebff8d206304. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 18:02:46.996833 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Getting quotas for user c54faad43103407ca99cedf7b8508144 and project 8a09caa450f94f3ea5b9ebff8d206304. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 18:02:47.008042 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 18:02:47.010326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 18:02:47.148567 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f9ea9b40-7ddc-42ff-aa0d-270daf746c6e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607357 Jul 20 18:02:47.149208 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 581/1152] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 18:02:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 18:02:47.157000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=22 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:47.157876 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=46 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:47.161986 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-7ac7e035-d4bf-4f2c-bf47-12d8299a54f3 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:47.162679 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-7ac7e035-d4bf-4f2c-bf47-12d8299a54f3 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:47.219782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-7ac7e035-d4bf-4f2c-bf47-12d8299a54f3 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:47.226597 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-7ac7e035-d4bf-4f2c-bf47-12d8299a54f3 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1213 microversion: 2.1 time: 0.071190 Jul 20 18:02:47.227087 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 572/1153] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:47 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:48.243376 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-cc9e0fcc-6eec-4230-8a11-4db5ce06c589 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:48.244231 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-cc9e0fcc-6eec-4230-8a11-4db5ce06c589 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:48.296916 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-cc9e0fcc-6eec-4230-8a11-4db5ce06c589 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:48.304193 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-cc9e0fcc-6eec-4230-8a11-4db5ce06c589 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1213 microversion: 2.1 time: 0.064798 Jul 20 18:02:48.304789 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 582/1154] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:48 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:49.320833 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-4c82b07e-fced-4315-a603-a905b7dc730a tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:49.321491 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-4c82b07e-fced-4315-a603-a905b7dc730a tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:49.374423 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-4c82b07e-fced-4315-a603-a905b7dc730a tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:49.381147 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-4c82b07e-fced-4315-a603-a905b7dc730a tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1213 microversion: 2.1 time: 0.064523 Jul 20 18:02:49.388110 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 573/1155] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:49 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:50.397840 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ab5f734c-ad16-4820-967c-22bc400c49c0 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:50.398389 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ab5f734c-ad16-4820-967c-22bc400c49c0 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:50.449861 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ab5f734c-ad16-4820-967c-22bc400c49c0 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:50.456510 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ab5f734c-ad16-4820-967c-22bc400c49c0 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1213 microversion: 2.1 time: 0.062605 Jul 20 18:02:50.457076 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 583/1156] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:50 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:51.052362 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 18:02:51.052634 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Wed Jul 20 18:02:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 18:02:51.473160 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-0edec20c-30f4-4f97-ae0b-f9bebc7b5bd1 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:51.473696 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-0edec20c-30f4-4f97-ae0b-f9bebc7b5bd1 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:51.528058 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-0edec20c-30f4-4f97-ae0b-f9bebc7b5bd1 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:51.535706 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-0edec20c-30f4-4f97-ae0b-f9bebc7b5bd1 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1213 microversion: 2.1 time: 0.066272 Jul 20 18:02:51.540466 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 574/1157] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:51 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:52.552778 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-6543d7d4-ad2a-4cde-91a8-1e5d5e1c7f74 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:52.553395 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-6543d7d4-ad2a-4cde-91a8-1e5d5e1c7f74 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:52.562542 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6543d7d4-ad2a-4cde-91a8-1e5d5e1c7f74 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:52.562994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6543d7d4-ad2a-4cde-91a8-1e5d5e1c7f74 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:52.563754 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6543d7d4-ad2a-4cde-91a8-1e5d5e1c7f74 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:52.564198 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-6543d7d4-ad2a-4cde-91a8-1e5d5e1c7f74 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:52.623826 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-6543d7d4-ad2a-4cde-91a8-1e5d5e1c7f74 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:52.631131 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-6543d7d4-ad2a-4cde-91a8-1e5d5e1c7f74 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1217 microversion: 2.1 time: 0.082183 Jul 20 18:02:52.631906 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 584/1158] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:52 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:53.647278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-115f0a11-aeb0-4434-8b77-f6a958bba1fd tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:53.647869 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-115f0a11-aeb0-4434-8b77-f6a958bba1fd tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:53.655403 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-115f0a11-aeb0-4434-8b77-f6a958bba1fd tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:53.655858 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-115f0a11-aeb0-4434-8b77-f6a958bba1fd tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:53.656679 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-115f0a11-aeb0-4434-8b77-f6a958bba1fd tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:53.657121 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-115f0a11-aeb0-4434-8b77-f6a958bba1fd tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:53.718476 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-115f0a11-aeb0-4434-8b77-f6a958bba1fd tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:53.726868 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-115f0a11-aeb0-4434-8b77-f6a958bba1fd tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1265 microversion: 2.1 time: 0.083702 Jul 20 18:02:53.730354 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 575/1159] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:53 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:54.746951 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-15965392-4fbd-4749-8cce-1c9e90ba8621 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:54.747555 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-15965392-4fbd-4749-8cce-1c9e90ba8621 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:54.757603 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-15965392-4fbd-4749-8cce-1c9e90ba8621 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:54.758923 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-15965392-4fbd-4749-8cce-1c9e90ba8621 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:54.759704 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-15965392-4fbd-4749-8cce-1c9e90ba8621 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:54.760179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-15965392-4fbd-4749-8cce-1c9e90ba8621 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:54.939486 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-15965392-4fbd-4749-8cce-1c9e90ba8621 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:54.947833 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-15965392-4fbd-4749-8cce-1c9e90ba8621 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1313 microversion: 2.1 time: 0.205549 Jul 20 18:02:54.958572 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 585/1160] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:54 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:55.769052 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-1fa18cc6-5b21-4348-a5a2-f83e8fbf6b33 req-4b2b2b65-34fc-47fa-97a8-b9b2897967cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb1c6e0-78c5-444b-af8c-61a67457231c", "tag": "d5ae1d44-a6bc-4c89-beb4-792c9be514e5"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:02:55.778793 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-1fa18cc6-5b21-4348-a5a2-f83e8fbf6b33 req-4b2b2b65-34fc-47fa-97a8-b9b2897967cb service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:55.779351 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-1fa18cc6-5b21-4348-a5a2-f83e8fbf6b33 req-4b2b2b65-34fc-47fa-97a8-b9b2897967cb service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:55.791638 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-1fa18cc6-5b21-4348-a5a2-f83e8fbf6b33 req-4b2b2b65-34fc-47fa-97a8-b9b2897967cb service nova] Creating event network-changed:d5ae1d44-a6bc-4c89-beb4-792c9be514e5 for instance 3cb1c6e0-78c5-444b-af8c-61a67457231c on hv-cinder-84984 Jul 20 18:02:55.796999 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-1fa18cc6-5b21-4348-a5a2-f83e8fbf6b33 req-4b2b2b65-34fc-47fa-97a8-b9b2897967cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032569 Jul 20 18:02:55.798250 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 576/1161] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:02:55.966197 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-d2b333db-74da-4e66-b694-7ca00f72e320 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:55.967171 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-d2b333db-74da-4e66-b694-7ca00f72e320 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:55.974312 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d2b333db-74da-4e66-b694-7ca00f72e320 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:55.978994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d2b333db-74da-4e66-b694-7ca00f72e320 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:55.978994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d2b333db-74da-4e66-b694-7ca00f72e320 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:55.978994 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-d2b333db-74da-4e66-b694-7ca00f72e320 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:56.176390 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-d2b333db-74da-4e66-b694-7ca00f72e320 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:56.183940 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-d2b333db-74da-4e66-b694-7ca00f72e320 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1313 microversion: 2.1 time: 0.221656 Jul 20 18:02:56.184536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 586/1162] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:55 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:57.202085 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-93cd3324-8964-4211-9540-396d654ffce6 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:57.202782 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-93cd3324-8964-4211-9540-396d654ffce6 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:57.209750 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93cd3324-8964-4211-9540-396d654ffce6 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:57.210241 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93cd3324-8964-4211-9540-396d654ffce6 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:57.211036 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93cd3324-8964-4211-9540-396d654ffce6 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:57.211473 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-93cd3324-8964-4211-9540-396d654ffce6 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:57.348467 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-93cd3324-8964-4211-9540-396d654ffce6 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:57.357326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-93cd3324-8964-4211-9540-396d654ffce6 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1313 microversion: 2.1 time: 0.159722 Jul 20 18:02:57.357979 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 577/1163] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:57 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:58.374735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-a62fbf6f-8ec4-4ae2-9a0b-6e8d976e7ce9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:58.375331 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-a62fbf6f-8ec4-4ae2-9a0b-6e8d976e7ce9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:58.377650 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:58.382515 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a62fbf6f-8ec4-4ae2-9a0b-6e8d976e7ce9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:58.382968 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a62fbf6f-8ec4-4ae2-9a0b-6e8d976e7ce9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:58.388495 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a62fbf6f-8ec4-4ae2-9a0b-6e8d976e7ce9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:58.390923 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-a62fbf6f-8ec4-4ae2-9a0b-6e8d976e7ce9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:58.520803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-a62fbf6f-8ec4-4ae2-9a0b-6e8d976e7ce9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:58.528592 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-a62fbf6f-8ec4-4ae2-9a0b-6e8d976e7ce9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1313 microversion: 2.1 time: 0.157547 Jul 20 18:02:58.529192 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 587/1164] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:58 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:02:59.546639 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-88360560-e143-4778-be8a-d090c9727a35 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:02:59.547253 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-88360560-e143-4778-be8a-d090c9727a35 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:02:59.554293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88360560-e143-4778-be8a-d090c9727a35 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:59.554765 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88360560-e143-4778-be8a-d090c9727a35 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:59.555676 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88360560-e143-4778-be8a-d090c9727a35 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:02:59.556254 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88360560-e143-4778-be8a-d090c9727a35 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:02:59.696278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-88360560-e143-4778-be8a-d090c9727a35 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:02:59.704016 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-88360560-e143-4778-be8a-d090c9727a35 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1313 microversion: 2.1 time: 0.161253 Jul 20 18:02:59.704599 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 578/1165] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:02:59 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:00.345554 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-4ecd7855-8694-46e1-828d-adca3e18a85e req-6e89c0f7-f2b2-4fad-ae32-c0fc9fa5d27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb1c6e0-78c5-444b-af8c-61a67457231c", "name": "network-vif-plugged", "status": "completed", "tag": "d5ae1d44-a6bc-4c89-beb4-792c9be514e5"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:03:00.354300 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-4ecd7855-8694-46e1-828d-adca3e18a85e req-6e89c0f7-f2b2-4fad-ae32-c0fc9fa5d27a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:00.354741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-4ecd7855-8694-46e1-828d-adca3e18a85e req-6e89c0f7-f2b2-4fad-ae32-c0fc9fa5d27a service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:00.365406 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-4ecd7855-8694-46e1-828d-adca3e18a85e req-6e89c0f7-f2b2-4fad-ae32-c0fc9fa5d27a service nova] Creating event network-vif-plugged:d5ae1d44-a6bc-4c89-beb4-792c9be514e5 for instance 3cb1c6e0-78c5-444b-af8c-61a67457231c on hv-cinder-84984 Jul 20 18:03:00.370338 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-4ecd7855-8694-46e1-828d-adca3e18a85e req-6e89c0f7-f2b2-4fad-ae32-c0fc9fa5d27a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028581 Jul 20 18:03:00.370907 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 588/1166] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 18:03:00.720702 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8b90d538-639e-4938-838c-a511bb62c67e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:00.727108 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8b90d538-639e-4938-838c-a511bb62c67e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:00.727708 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b90d538-639e-4938-838c-a511bb62c67e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:00.728165 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b90d538-639e-4938-838c-a511bb62c67e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:00.728966 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b90d538-639e-4938-838c-a511bb62c67e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:00.729410 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8b90d538-639e-4938-838c-a511bb62c67e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:00.915233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8b90d538-639e-4938-838c-a511bb62c67e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:00.922845 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8b90d538-639e-4938-838c-a511bb62c67e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1313 microversion: 2.1 time: 0.206012 Jul 20 18:03:00.923416 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 579/1167] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:00 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:01.941137 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c44a74b3-550e-4d26-b5e2-17cadbe2f15b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:01.941852 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c44a74b3-550e-4d26-b5e2-17cadbe2f15b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:01.944737 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=10 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:01.950959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c44a74b3-550e-4d26-b5e2-17cadbe2f15b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:01.956788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c44a74b3-550e-4d26-b5e2-17cadbe2f15b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:01.956788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c44a74b3-550e-4d26-b5e2-17cadbe2f15b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:01.956788 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c44a74b3-550e-4d26-b5e2-17cadbe2f15b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:02.110944 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c44a74b3-550e-4d26-b5e2-17cadbe2f15b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:02.119078 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c44a74b3-550e-4d26-b5e2-17cadbe2f15b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1313 microversion: 2.1 time: 0.182317 Jul 20 18:03:02.119738 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 589/1168] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:01 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:02.381084 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 18:03:02.381609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Wed Jul 20 18:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 18:03:03.135129 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-81d0b83b-ab04-4f5d-b0ec-19dc77cbdf68 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:03.135801 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-81d0b83b-ab04-4f5d-b0ec-19dc77cbdf68 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:03.137941 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=6 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:03.143672 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81d0b83b-ab04-4f5d-b0ec-19dc77cbdf68 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:03.152014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81d0b83b-ab04-4f5d-b0ec-19dc77cbdf68 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:03.152014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81d0b83b-ab04-4f5d-b0ec-19dc77cbdf68 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:03.152014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-81d0b83b-ab04-4f5d-b0ec-19dc77cbdf68 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:03.275605 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-81d0b83b-ab04-4f5d-b0ec-19dc77cbdf68 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:03.283127 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-81d0b83b-ab04-4f5d-b0ec-19dc77cbdf68 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1497 microversion: 2.1 time: 0.151896 Jul 20 18:03:03.284192 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 580/1169] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:03 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:04.414018 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-97710686-76e8-43f3-8deb-b6e4f8a0ae0c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:04.414590 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-97710686-76e8-43f3-8deb-b6e4f8a0ae0c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:04.421659 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-97710686-76e8-43f3-8deb-b6e4f8a0ae0c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:04.422394 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-97710686-76e8-43f3-8deb-b6e4f8a0ae0c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:04.423297 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-97710686-76e8-43f3-8deb-b6e4f8a0ae0c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:04.423735 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-97710686-76e8-43f3-8deb-b6e4f8a0ae0c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:04.451340 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-97710686-76e8-43f3-8deb-b6e4f8a0ae0c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 18:03:04.808274 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-97710686-76e8-43f3-8deb-b6e4f8a0ae0c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 204 len: 0 microversion: 2.1 time: 0.398937 Jul 20 18:03:04.808893 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 590/1170] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 18:03:04 2022] DELETE /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 18:03:04.817649 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-e37360cc-d362-44c0-a3b5-5071e357f73b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:04.818916 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-e37360cc-d362-44c0-a3b5-5071e357f73b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:04.825226 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e37360cc-d362-44c0-a3b5-5071e357f73b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:04.825702 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e37360cc-d362-44c0-a3b5-5071e357f73b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:04.826502 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e37360cc-d362-44c0-a3b5-5071e357f73b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:04.826965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-e37360cc-d362-44c0-a3b5-5071e357f73b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:04.961076 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-e37360cc-d362-44c0-a3b5-5071e357f73b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:04.968425 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-e37360cc-d362-44c0-a3b5-5071e357f73b tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1503 microversion: 2.1 time: 0.155284 Jul 20 18:03:04.969008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 581/1171] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:04 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:05.990357 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ffb87c84-2c3e-48fd-be53-fd4adfae5010 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:05.991090 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ffb87c84-2c3e-48fd-be53-fd4adfae5010 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:06.001874 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ffb87c84-2c3e-48fd-be53-fd4adfae5010 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:06.002596 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ffb87c84-2c3e-48fd-be53-fd4adfae5010 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:06.003732 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ffb87c84-2c3e-48fd-be53-fd4adfae5010 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:06.004326 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ffb87c84-2c3e-48fd-be53-fd4adfae5010 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:06.148597 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ffb87c84-2c3e-48fd-be53-fd4adfae5010 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:06.156834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ffb87c84-2c3e-48fd-be53-fd4adfae5010 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1503 microversion: 2.1 time: 0.173437 Jul 20 18:03:06.157768 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 591/1172] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:05 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:06.972930 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-e9a1d624-19bf-4ea7-bc59-7ef4d62c33f0 req-a4421938-9ddb-4735-80dd-d5e47b631100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb1c6e0-78c5-444b-af8c-61a67457231c", "name": "network-vif-deleted", "tag": "d5ae1d44-a6bc-4c89-beb4-792c9be514e5"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:03:06.981524 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e9a1d624-19bf-4ea7-bc59-7ef4d62c33f0 req-a4421938-9ddb-4735-80dd-d5e47b631100 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:06.982198 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-e9a1d624-19bf-4ea7-bc59-7ef4d62c33f0 req-a4421938-9ddb-4735-80dd-d5e47b631100 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:06.994445 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-e9a1d624-19bf-4ea7-bc59-7ef4d62c33f0 req-a4421938-9ddb-4735-80dd-d5e47b631100 service nova] Creating event network-vif-deleted:d5ae1d44-a6bc-4c89-beb4-792c9be514e5 for instance 3cb1c6e0-78c5-444b-af8c-61a67457231c on hv-cinder-84984 Jul 20 18:03:06.999771 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-e9a1d624-19bf-4ea7-bc59-7ef4d62c33f0 req-a4421938-9ddb-4735-80dd-d5e47b631100 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030318 Jul 20 18:03:07.000396 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 582/1173] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:03:07.175132 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-86652875-8c19-4184-8bc4-54a19fb1279e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:07.175764 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-86652875-8c19-4184-8bc4-54a19fb1279e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:07.182521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-86652875-8c19-4184-8bc4-54a19fb1279e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:07.182959 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-86652875-8c19-4184-8bc4-54a19fb1279e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:07.183713 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-86652875-8c19-4184-8bc4-54a19fb1279e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:07.184145 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-86652875-8c19-4184-8bc4-54a19fb1279e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:07.250520 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-86652875-8c19-4184-8bc4-54a19fb1279e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:07.257987 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-86652875-8c19-4184-8bc4-54a19fb1279e tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 200 len: 1298 microversion: 2.1 time: 0.087472 Jul 20 18:03:07.259536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 592/1174] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:07 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:08.275968 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:08.276698 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 3cb1c6e0-78c5-444b-af8c-61a67457231c] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:08.283054 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:08.283497 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:08.284249 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:08.284714 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:08.297850 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] HTTP exception thrown: Instance 3cb1c6e0-78c5-444b-af8c-61a67457231c could not be found. Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Request method failure captured: Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c HTTP/1.1 Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2ENEqQyNDGJ5zR9By2WkbF-BLcDzdxt5aumDpMVU2DY3uGR9Nl-6PO90vn-qH5lEGvr_591fXn6O_C3f_nDliG5lzAljwr6AmHMbf7ENcnAne073qC-M2hbYIF4iTv0cPhei_djXWgvmATF2vlEatVtBcbEkitHaWivewNcYpwxE2XI Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 8a09caa450f94f3ea5b9ebff8d206304 Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesActionsTest-1716016965 Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 18:03:08.299973 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8a09caa450f94f3ea5b9ebff8d206304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a09caa450f94f3ea5b9ebff8d206304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a09caa450f94f3ea5b9ebff8d206304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8a09caa450f94f3ea5b9ebff8d206304"}]}] Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesActionsTest-1716016965 Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 8a09caa450f94f3ea5b9ebff8d206304 Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesActionsTest-1716016965 Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesActionsTest-1716016965-project Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: c54faad43103407ca99cedf7b8508144 Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesActionsTest-1716016965-project Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 3cb1c6e0-78c5-444b-af8c-61a67457231c could not be found. Jul 20 18:03:08.301581 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '3cb1c6e0-78c5-444b-af8c-61a67457231c'} Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb1c6e0-78c5-444b-af8c-61a67457231c could not be found. Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:03:08.302429 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb1c6e0-78c5-444b-af8c-61a67457231c could not be found. Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb1c6e0-78c5-444b-af8c-61a67457231c could not be found. Jul 20 18:03:08.303809 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:08.305076 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Returning 404 to user: Instance 3cb1c6e0-78c5-444b-af8c-61a67457231c could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:03:08.305076 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-fba3ad07-52e0-4de7-9ba7-25dcd955fdbf tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c" status: 404 len: 111 microversion: 2.1 time: 0.030255 Jul 20 18:03:08.305076 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 583/1175] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:08 2022] GET /compute/v2.1/servers/3cb1c6e0-78c5-444b-af8c-61a67457231c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 18:03:08.348558 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2034957350", "imageRef": "fab25893-1ab1-408e-a832-7d39b4329c19", "flavorRef": "452", "networks": [{"uuid": "02579f11-c2b8-4329-9fbc-78c5ebb8e8a3"}]}} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:03:08.399924 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.network.neutron [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] validate_networks() for [('02579f11-c2b8-4329-9fbc-78c5ebb8e8a3', None, None, None, None, None)] {{(pid=124846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 18:03:08.752834 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Flavor limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 18:03:08.753258 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Image limits 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 18:03:08.753732 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Flavor pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 18:03:08.754142 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Image pref 0:0:0 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 18:03:08.754552 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.virt.hardware [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 18:03:08.763530 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:08.763979 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:08.764824 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:08.765304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:08.781795 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Getting quotas for project 8a09caa450f94f3ea5b9ebff8d206304. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 18:03:08.786277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.quota [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Getting quotas for user c54faad43103407ca99cedf7b8508144 and project 8a09caa450f94f3ea5b9ebff8d206304. Resources: {'ram', 'instances', 'cores'} {{(pid=124846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 18:03:08.797740 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Going to run 1 instances... {{(pid=124846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 18:03:08.800720 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fab25893-1ab1-408e-a832-7d39b4329c19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 18:03:08.981413 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-38803fbb-8d79-4d08-9ad2-7d4d8470aa97 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636616 Jul 20 18:03:08.982064 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 593/1176] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jul 20 18:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 18:03:08.991786 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-cad7b099-a3a8-4961-9222-7827cfceaf20 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:08.992405 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-cad7b099-a3a8-4961-9222-7827cfceaf20 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:09.047532 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-cad7b099-a3a8-4961-9222-7827cfceaf20 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:09.054833 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-cad7b099-a3a8-4961-9222-7827cfceaf20 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1214 microversion: 2.1 time: 0.066777 Jul 20 18:03:09.055414 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 584/1177] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:08 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:10.072154 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-b2d1e737-2a1c-48c4-b732-6718e9787ea9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:10.072803 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-b2d1e737-2a1c-48c4-b732-6718e9787ea9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:10.129683 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-b2d1e737-2a1c-48c4-b732-6718e9787ea9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:10.136773 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-b2d1e737-2a1c-48c4-b732-6718e9787ea9 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1214 microversion: 2.1 time: 0.068964 Jul 20 18:03:10.141696 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 594/1178] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:10 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:11.153564 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-04fa766e-0e06-4ab1-9dba-a129e9c24167 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:11.154173 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-04fa766e-0e06-4ab1-9dba-a129e9c24167 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:11.162094 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-04fa766e-0e06-4ab1-9dba-a129e9c24167 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:11.162539 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-04fa766e-0e06-4ab1-9dba-a129e9c24167 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:11.163370 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-04fa766e-0e06-4ab1-9dba-a129e9c24167 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:11.163813 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-04fa766e-0e06-4ab1-9dba-a129e9c24167 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:11.230689 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-04fa766e-0e06-4ab1-9dba-a129e9c24167 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:11.238519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-04fa766e-0e06-4ab1-9dba-a129e9c24167 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1266 microversion: 2.1 time: 0.088662 Jul 20 18:03:11.239184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 585/1179] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:11 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:12.255911 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-ba9573dd-f13f-4f57-80fe-c6e3f0c95899 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:12.256545 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-ba9573dd-f13f-4f57-80fe-c6e3f0c95899 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:12.263124 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba9573dd-f13f-4f57-80fe-c6e3f0c95899 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:12.268123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba9573dd-f13f-4f57-80fe-c6e3f0c95899 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:12.268123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba9573dd-f13f-4f57-80fe-c6e3f0c95899 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:12.268123 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-ba9573dd-f13f-4f57-80fe-c6e3f0c95899 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:12.464415 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-ba9573dd-f13f-4f57-80fe-c6e3f0c95899 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:12.472726 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-ba9573dd-f13f-4f57-80fe-c6e3f0c95899 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1314 microversion: 2.1 time: 0.221231 Jul 20 18:03:12.473304 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 595/1180] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:12 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:13.128344 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-3bb9c16e-7551-4324-9b54-b47cab65beb5 req-0d4ab4be-4301-4b97-a8f0-b8a0a6d006bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9c5361-b156-4d84-b8bf-4f99eb13cd03", "tag": "ffce57d6-1ddf-4fa2-9781-0e03ed96fabc"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:03:13.138010 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-3bb9c16e-7551-4324-9b54-b47cab65beb5 req-0d4ab4be-4301-4b97-a8f0-b8a0a6d006bf service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:13.146245 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-3bb9c16e-7551-4324-9b54-b47cab65beb5 req-0d4ab4be-4301-4b97-a8f0-b8a0a6d006bf service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:13.152188 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-3bb9c16e-7551-4324-9b54-b47cab65beb5 req-0d4ab4be-4301-4b97-a8f0-b8a0a6d006bf service nova] Creating event network-changed:ffce57d6-1ddf-4fa2-9781-0e03ed96fabc for instance 8d9c5361-b156-4d84-b8bf-4f99eb13cd03 on hv-cinder-84984 Jul 20 18:03:13.157220 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-3bb9c16e-7551-4324-9b54-b47cab65beb5 req-0d4ab4be-4301-4b97-a8f0-b8a0a6d006bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033088 Jul 20 18:03:13.157820 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 586/1181] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:03:13.489692 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-c42d28e0-5370-4f4a-a330-a913f9432bdb tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:13.490301 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-c42d28e0-5370-4f4a-a330-a913f9432bdb tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:13.496973 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c42d28e0-5370-4f4a-a330-a913f9432bdb tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:13.497346 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c42d28e0-5370-4f4a-a330-a913f9432bdb tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:13.498115 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c42d28e0-5370-4f4a-a330-a913f9432bdb tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:13.499180 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-c42d28e0-5370-4f4a-a330-a913f9432bdb tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:13.724660 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-c42d28e0-5370-4f4a-a330-a913f9432bdb tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:13.732359 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-c42d28e0-5370-4f4a-a330-a913f9432bdb tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1314 microversion: 2.1 time: 0.246505 Jul 20 18:03:13.732967 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 596/1182] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:13 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:14.750870 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-687b8d7b-750e-4a51-bc59-688f8873ea9d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:14.751558 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-687b8d7b-750e-4a51-bc59-688f8873ea9d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:14.758356 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-687b8d7b-750e-4a51-bc59-688f8873ea9d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:14.758796 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-687b8d7b-750e-4a51-bc59-688f8873ea9d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:14.759550 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-687b8d7b-750e-4a51-bc59-688f8873ea9d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:14.759976 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-687b8d7b-750e-4a51-bc59-688f8873ea9d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:14.891385 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-687b8d7b-750e-4a51-bc59-688f8873ea9d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:14.899426 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-687b8d7b-750e-4a51-bc59-688f8873ea9d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1314 microversion: 2.1 time: 0.153304 Jul 20 18:03:14.899995 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 587/1183] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:14 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:15.917700 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-172d9e93-7ced-4c73-b031-6d85287cc693 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:15.918324 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-172d9e93-7ced-4c73-b031-6d85287cc693 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:15.924964 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-172d9e93-7ced-4c73-b031-6d85287cc693 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:15.925416 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-172d9e93-7ced-4c73-b031-6d85287cc693 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:15.926194 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-172d9e93-7ced-4c73-b031-6d85287cc693 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:15.926631 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-172d9e93-7ced-4c73-b031-6d85287cc693 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:16.061012 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-172d9e93-7ced-4c73-b031-6d85287cc693 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:16.069334 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-172d9e93-7ced-4c73-b031-6d85287cc693 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1314 microversion: 2.1 time: 0.155540 Jul 20 18:03:16.069903 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 597/1184] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:15 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:17.085652 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ceb3312f-3d5e-482c-b1ef-42ea44591c18 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:17.086260 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ceb3312f-3d5e-482c-b1ef-42ea44591c18 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:17.093032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ceb3312f-3d5e-482c-b1ef-42ea44591c18 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:17.093483 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ceb3312f-3d5e-482c-b1ef-42ea44591c18 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:17.094257 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ceb3312f-3d5e-482c-b1ef-42ea44591c18 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:17.094694 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ceb3312f-3d5e-482c-b1ef-42ea44591c18 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:17.241889 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ceb3312f-3d5e-482c-b1ef-42ea44591c18 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:17.249565 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ceb3312f-3d5e-482c-b1ef-42ea44591c18 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1314 microversion: 2.1 time: 0.167780 Jul 20 18:03:17.250131 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 588/1185] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:17 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:18.267097 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bc121118-d69c-48a8-9bfe-9f68c4c52df8 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:18.267687 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-bc121118-d69c-48a8-9bfe-9f68c4c52df8 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:18.270294 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:18.275365 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bc121118-d69c-48a8-9bfe-9f68c4c52df8 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:18.275811 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bc121118-d69c-48a8-9bfe-9f68c4c52df8 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:18.276602 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bc121118-d69c-48a8-9bfe-9f68c4c52df8 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:18.277067 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bc121118-d69c-48a8-9bfe-9f68c4c52df8 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:18.279610 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:18.417522 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-bc121118-d69c-48a8-9bfe-9f68c4c52df8 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:18.417522 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-bc121118-d69c-48a8-9bfe-9f68c4c52df8 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1314 microversion: 2.1 time: 0.153051 Jul 20 18:03:18.417522 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 598/1186] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:18 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 18:03:18.484569 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-80b7f3e8-4d8a-4e24-be34-cc14798a36d3 req-1accc8a6-fddf-40ba-9894-cae280d891a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c5361-b156-4d84-b8bf-4f99eb13cd03", "name": "network-vif-plugged", "status": "completed", "tag": "ffce57d6-1ddf-4fa2-9781-0e03ed96fabc"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:03:18.493888 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-80b7f3e8-4d8a-4e24-be34-cc14798a36d3 req-1accc8a6-fddf-40ba-9894-cae280d891a5 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:18.494342 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-80b7f3e8-4d8a-4e24-be34-cc14798a36d3 req-1accc8a6-fddf-40ba-9894-cae280d891a5 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:18.505184 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-80b7f3e8-4d8a-4e24-be34-cc14798a36d3 req-1accc8a6-fddf-40ba-9894-cae280d891a5 service nova] Creating event network-vif-plugged:ffce57d6-1ddf-4fa2-9781-0e03ed96fabc for instance 8d9c5361-b156-4d84-b8bf-4f99eb13cd03 on hv-cinder-84984 Jul 20 18:03:18.510227 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-80b7f3e8-4d8a-4e24-be34-cc14798a36d3 req-1accc8a6-fddf-40ba-9894-cae280d891a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029894 Jul 20 18:03:18.526097 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 589/1187] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:03:19.435446 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-aac41d47-95cd-4afd-8b14-c332628de3ce tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:19.436151 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-aac41d47-95cd-4afd-8b14-c332628de3ce tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:19.438301 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=2 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:19.446299 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-aac41d47-95cd-4afd-8b14-c332628de3ce tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:19.446904 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-aac41d47-95cd-4afd-8b14-c332628de3ce tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:19.447909 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-aac41d47-95cd-4afd-8b14-c332628de3ce tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:19.448508 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-aac41d47-95cd-4afd-8b14-c332628de3ce tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:19.585000 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-aac41d47-95cd-4afd-8b14-c332628de3ce tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:19.592458 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-aac41d47-95cd-4afd-8b14-c332628de3ce tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1314 microversion: 2.1 time: 0.162420 Jul 20 18:03:19.593035 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 599/1188] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:19 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:20.606318 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell0:SELECT=2 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:20.610922 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-c5dd6c94-8acd-4d14-be21-2e7524cc5199 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:20.611733 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-c5dd6c94-8acd-4d14-be21-2e7524cc5199 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:20.613627 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=45 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:20.619083 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c5dd6c94-8acd-4d14-be21-2e7524cc5199 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:20.619250 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c5dd6c94-8acd-4d14-be21-2e7524cc5199 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:20.620032 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c5dd6c94-8acd-4d14-be21-2e7524cc5199 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:20.620493 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-c5dd6c94-8acd-4d14-be21-2e7524cc5199 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:20.624477 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=65 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:20.751626 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-c5dd6c94-8acd-4d14-be21-2e7524cc5199 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:20.759562 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-c5dd6c94-8acd-4d14-be21-2e7524cc5199 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1498 microversion: 2.1 time: 0.154164 Jul 20 18:03:20.760262 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 590/1189] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:20 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:21.812211 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-5a9a53e3-0cfc-45a2-bb04-ba29b95d831d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:21.812820 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5a9a53e3-0cfc-45a2-bb04-ba29b95d831d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:21.814705 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell0:SELECT=8 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:21.822009 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5a9a53e3-0cfc-45a2-bb04-ba29b95d831d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:21.822462 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5a9a53e3-0cfc-45a2-bb04-ba29b95d831d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:21.823226 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5a9a53e3-0cfc-45a2-bb04-ba29b95d831d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:21.823659 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-5a9a53e3-0cfc-45a2-bb04-ba29b95d831d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:21.850248 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-5a9a53e3-0cfc-45a2-bb04-ba29b95d831d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 18:03:22.282350 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-5a9a53e3-0cfc-45a2-bb04-ba29b95d831d tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 204 len: 0 microversion: 2.1 time: 0.474599 Jul 20 18:03:22.377624 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 600/1190] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 18:03:21 2022] DELETE /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 18:03:22.377804 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-a6939631-0f58-4990-bbae-81d59fb198f7 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:22.377804 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-a6939631-0f58-4990-bbae-81d59fb198f7 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:22.377804 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6939631-0f58-4990-bbae-81d59fb198f7 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:22.377804 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6939631-0f58-4990-bbae-81d59fb198f7 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:22.378584 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6939631-0f58-4990-bbae-81d59fb198f7 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:22.378584 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-a6939631-0f58-4990-bbae-81d59fb198f7 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:22.441120 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-a6939631-0f58-4990-bbae-81d59fb198f7 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:22.449029 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-a6939631-0f58-4990-bbae-81d59fb198f7 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1504 microversion: 2.1 time: 0.160683 Jul 20 18:03:22.449620 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 591/1191] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:22 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:23.466842 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-08dc5efc-bb73-4858-80b5-ff6d2a0c898c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:23.467721 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-08dc5efc-bb73-4858-80b5-ff6d2a0c898c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:23.474521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08dc5efc-bb73-4858-80b5-ff6d2a0c898c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:23.474975 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08dc5efc-bb73-4858-80b5-ff6d2a0c898c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:23.475777 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08dc5efc-bb73-4858-80b5-ff6d2a0c898c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:23.476218 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-08dc5efc-bb73-4858-80b5-ff6d2a0c898c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:23.607192 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-08dc5efc-bb73-4858-80b5-ff6d2a0c898c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:23.615349 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-08dc5efc-bb73-4858-80b5-ff6d2a0c898c tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1504 microversion: 2.1 time: 0.152924 Jul 20 18:03:23.615904 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 601/1192] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:23 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:24.463280 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-f698d41f-4f37-48ad-9064-d3101a3104b9 req-f10b3afe-1136-4049-9744-6aeb485c211c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c5361-b156-4d84-b8bf-4f99eb13cd03", "name": "network-vif-deleted", "tag": "ffce57d6-1ddf-4fa2-9781-0e03ed96fabc"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:03:24.472838 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f698d41f-4f37-48ad-9064-d3101a3104b9 req-f10b3afe-1136-4049-9744-6aeb485c211c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:24.473282 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-f698d41f-4f37-48ad-9064-d3101a3104b9 req-f10b3afe-1136-4049-9744-6aeb485c211c service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:24.484563 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-f698d41f-4f37-48ad-9064-d3101a3104b9 req-f10b3afe-1136-4049-9744-6aeb485c211c service nova] Creating event network-vif-deleted:ffce57d6-1ddf-4fa2-9781-0e03ed96fabc for instance 8d9c5361-b156-4d84-b8bf-4f99eb13cd03 on hv-cinder-84984 Jul 20 18:03:24.490070 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-f698d41f-4f37-48ad-9064-d3101a3104b9 req-f10b3afe-1136-4049-9744-6aeb485c211c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030854 Jul 20 18:03:24.490636 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 592/1193] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:03:24.632624 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-06e4e831-77b7-4a1e-aebd-300286233a54 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:24.633164 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-06e4e831-77b7-4a1e-aebd-300286233a54 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:24.640032 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-06e4e831-77b7-4a1e-aebd-300286233a54 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:24.640611 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-06e4e831-77b7-4a1e-aebd-300286233a54 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:24.641427 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-06e4e831-77b7-4a1e-aebd-300286233a54 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:24.641887 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-06e4e831-77b7-4a1e-aebd-300286233a54 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:24.707287 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-06e4e831-77b7-4a1e-aebd-300286233a54 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54faad43103407ca99cedf7b8508144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a09caa450f94f3ea5b9ebff8d206304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:24.714905 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-06e4e831-77b7-4a1e-aebd-300286233a54 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 200 len: 1462 microversion: 2.1 time: 0.086247 Jul 20 18:03:24.715482 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 602/1194] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:24 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:25.732630 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:25.733362 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] [instance: 8d9c5361-b156-4d84-b8bf-4f99eb13cd03] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:25.740233 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:25.740711 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:25.741519 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:25.741961 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:25.755725 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] HTTP exception thrown: Instance 8d9c5361-b156-4d84-b8bf-4f99eb13cd03 could not be found. Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Request method failure captured: Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 HTTP/1.1 Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2ENEqQyNDGJ5zR9By2WkbF-BLcDzdxt5aumDpMVU2DY3uGR9Nl-6PO90vn-qH5lEGvr_591fXn6O_C3f_nDliG5lzAljwr6AmHMbf7ENcnAne073qC-M2hbYIF4iTv0cPhei_djXWgvmATF2vlEatVtBcbEkitHaWivewNcYpwxE2XI Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: 8a09caa450f94f3ea5b9ebff8d206304 Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-VolumesActionsTest-1716016965 Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 18:03:25.757303 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8a09caa450f94f3ea5b9ebff8d206304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a09caa450f94f3ea5b9ebff8d206304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8a09caa450f94f3ea5b9ebff8d206304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8a09caa450f94f3ea5b9ebff8d206304"}]}] Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-VolumesActionsTest-1716016965 Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: 8a09caa450f94f3ea5b9ebff8d206304 Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-VolumesActionsTest-1716016965 Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-VolumesActionsTest-1716016965-project Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: c54faad43103407ca99cedf7b8508144 Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-VolumesActionsTest-1716016965-project Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 8d9c5361-b156-4d84-b8bf-4f99eb13cd03 could not be found. Jul 20 18:03:25.759155 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '8d9c5361-b156-4d84-b8bf-4f99eb13cd03'} Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9c5361-b156-4d84-b8bf-4f99eb13cd03 could not be found. Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:03:25.760326 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9c5361-b156-4d84-b8bf-4f99eb13cd03 could not be found. Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9c5361-b156-4d84-b8bf-4f99eb13cd03 could not be found. Jul 20 18:03:25.762475 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:25.764506 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] Returning 404 to user: Instance 8d9c5361-b156-4d84-b8bf-4f99eb13cd03 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:03:25.764506 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-b81b9e55-80b6-4be5-8590-f0f0a4ec6390 tempest-VolumesActionsTest-1716016965 tempest-VolumesActionsTest-1716016965-project] 10.222.0.42 "GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03" status: 404 len: 111 microversion: 2.1 time: 0.030898 Jul 20 18:03:25.764506 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 593/1195] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:25 2022] GET /compute/v2.1/servers/8d9c5361-b156-4d84-b8bf-4f99eb13cd03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:03:48.572035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3ba96309-639f-45d7-bdf6-520edbf5b9ad tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:48.579327 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-a96c7d3b-2c9b-4668-a389-b9e30304e8c7 req-903c8094-babe-478f-824c-2222c40a62e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80fd9508-a183-4d46-a96e-ab26bebdbc22", "tag": "ae0948b9-34bf-4223-b1ca-440f0354b93f"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:03:48.580097 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3ba96309-639f-45d7-bdf6-520edbf5b9ad tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:48.582734 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_api:SELECT=7 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:48.586527 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG dbcounter [-] [124845] Writing DB stats nova_cell1:SELECT=15 {{(pid=124845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:48.590484 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:48.593013 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG dbcounter [-] [124846] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:48.597532 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ba96309-639f-45d7-bdf6-520edbf5b9ad tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:48.598182 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ba96309-639f-45d7-bdf6-520edbf5b9ad tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:48.600028 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-a96c7d3b-2c9b-4668-a389-b9e30304e8c7 req-903c8094-babe-478f-824c-2222c40a62e9 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:48.600940 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ba96309-639f-45d7-bdf6-520edbf5b9ad tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:48.601568 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3ba96309-639f-45d7-bdf6-520edbf5b9ad tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:48.606063 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-a96c7d3b-2c9b-4668-a389-b9e30304e8c7 req-903c8094-babe-478f-824c-2222c40a62e9 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:48.621398 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-a96c7d3b-2c9b-4668-a389-b9e30304e8c7 req-903c8094-babe-478f-824c-2222c40a62e9 service nova] Creating event network-changed:ae0948b9-34bf-4223-b1ca-440f0354b93f for instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 on hv-cinder-84984 Jul 20 18:03:48.626872 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-a96c7d3b-2c9b-4668-a389-b9e30304e8c7 req-903c8094-babe-478f-824c-2222c40a62e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063995 Jul 20 18:03:48.627728 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 603/1196] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:03:48.631636 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3ba96309-639f-45d7-bdf6-520edbf5b9ad tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Going to try to terminate instance {{(pid=124845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 18:03:49.442823 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3ba96309-639f-45d7-bdf6-520edbf5b9ad tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "DELETE /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 204 len: 0 microversion: 2.1 time: 0.874180 Jul 20 18:03:49.448888 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 594/1197] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 18:03:48 2022] DELETE /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 18:03:49.453179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-bdb7629d-2380-46e0-8896-662d518eb130 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:49.453903 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-bdb7629d-2380-46e0-8896-662d518eb130 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:49.461840 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bdb7629d-2380-46e0-8896-662d518eb130 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:49.462312 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bdb7629d-2380-46e0-8896-662d518eb130 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:49.463095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bdb7629d-2380-46e0-8896-662d518eb130 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:49.463530 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-bdb7629d-2380-46e0-8896-662d518eb130 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:49.611049 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-bdb7629d-2380-46e0-8896-662d518eb130 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:49.618992 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-bdb7629d-2380-46e0-8896-662d518eb130 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1457 microversion: 2.1 time: 0.171061 Jul 20 18:03:49.619781 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 604/1198] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:49 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1457 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:50.637299 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-3d2c712d-d3e1-467e-bd9c-4ad17cf8f0e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:50.637999 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-3d2c712d-d3e1-467e-bd9c-4ad17cf8f0e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:50.645292 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3d2c712d-d3e1-467e-bd9c-4ad17cf8f0e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:50.645731 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3d2c712d-d3e1-467e-bd9c-4ad17cf8f0e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:50.646499 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3d2c712d-d3e1-467e-bd9c-4ad17cf8f0e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:50.646921 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-3d2c712d-d3e1-467e-bd9c-4ad17cf8f0e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:50.803124 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-3d2c712d-d3e1-467e-bd9c-4ad17cf8f0e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:50.811035 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-3d2c712d-d3e1-467e-bd9c-4ad17cf8f0e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1457 microversion: 2.1 time: 0.178051 Jul 20 18:03:50.811603 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 595/1199] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:50 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1457 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:51.754924 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [req-b72ddad7-34ed-4f40-b5a6-f6c15c04ef0a req-1349a8da-8b3f-4d72-956d-d089f61c5592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80fd9508-a183-4d46-a96e-ab26bebdbc22", "name": "network-vif-deleted", "tag": "ae0948b9-34bf-4223-b1ca-440f0354b93f"}]} {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:03:51.754924 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-b72ddad7-34ed-4f40-b5a6-f6c15c04ef0a req-1349a8da-8b3f-4d72-956d-d089f61c5592 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:51.754924 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [req-b72ddad7-34ed-4f40-b5a6-f6c15c04ef0a req-1349a8da-8b3f-4d72-956d-d089f61c5592 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:51.757899 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.compute.server_external_events [req-b72ddad7-34ed-4f40-b5a6-f6c15c04ef0a req-1349a8da-8b3f-4d72-956d-d089f61c5592 service nova] Creating event network-vif-deleted:ae0948b9-34bf-4223-b1ca-440f0354b93f for instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 on hv-cinder-84984 Jul 20 18:03:51.761786 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [req-b72ddad7-34ed-4f40-b5a6-f6c15c04ef0a req-1349a8da-8b3f-4d72-956d-d089f61c5592 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030350 Jul 20 18:03:51.762370 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 605/1200] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:03:51.830808 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-8effbe6a-a4b9-470e-a9c1-f5fddcb9aee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:51.831414 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-8effbe6a-a4b9-470e-a9c1-f5fddcb9aee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:51.838173 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8effbe6a-a4b9-470e-a9c1-f5fddcb9aee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:51.838625 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8effbe6a-a4b9-470e-a9c1-f5fddcb9aee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:51.839387 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8effbe6a-a4b9-470e-a9c1-f5fddcb9aee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:51.839813 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-8effbe6a-a4b9-470e-a9c1-f5fddcb9aee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:51.910008 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-8effbe6a-a4b9-470e-a9c1-f5fddcb9aee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:51.918048 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-8effbe6a-a4b9-470e-a9c1-f5fddcb9aee7 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1389 microversion: 2.1 time: 0.091672 Jul 20 18:03:51.918643 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 596/1201] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:51 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:52.936061 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:52.936776 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:52.944015 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:52.944480 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:52.945242 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:52.945670 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:52.986426 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:52.986921 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:52.987393 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.objects.instance [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lazy-loading 'fault' on Instance uuid 80fd9508-a183-4d46-a96e-ab26bebdbc22 {{(pid=124846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 18:03:53.032837 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:53.040953 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-75f42009-2384-4acd-881b-bcc40e795f79 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 200 len: 1229 microversion: 2.1 time: 0.109573 Jul 20 18:03:53.041542 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 606/1202] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:52 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:54.058534 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:54.059186 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 80fd9508-a183-4d46-a96e-ab26bebdbc22] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:54.068658 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:54.069110 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:54.069912 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:54.070347 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:54.085210 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] HTTP exception thrown: Instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 could not be found. Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Request method failure captured: Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 HTTP/1.1 Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EHkB9X-W9u1AXPktfbc67p2akARB0zxGQo1NwsEnBd69tV2k03ACyc0c3QbThzhHRvlJ6KLa4Ai8W2pGZoSV_U8J1MCE2JXJMMcyfmw_9VRtyHh_5oTwTbCA-JLmOQaIg9akJ8S-IKz3ilozfE_cG5CYBdsJlFnNpyAvYFC4MXT5GA Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 18:03:54.086880 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be1213650f38494aa2aeb1aadc7ccbc7"}]}] Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-TestVolumeBootPattern-35907800 Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-TestVolumeBootPattern-35907800-project Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 9c95e9df33ad4f819f26fb8b695df7e9 Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-TestVolumeBootPattern-35907800-project Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 could not be found. Jul 20 18:03:54.088609 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '80fd9508-a183-4d46-a96e-ab26bebdbc22'} Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 could not be found. Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:03:54.089596 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 could not be found. Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 could not be found. Jul 20 18:03:54.091278 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:03:54.092856 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Returning 404 to user: Instance 80fd9508-a183-4d46-a96e-ab26bebdbc22 could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:03:54.092856 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-bac802f9-b837-4d14-b261-0b5f0102cda6 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22" status: 404 len: 111 microversion: 2.1 time: 0.033777 Jul 20 18:03:54.092856 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 597/1203] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:54 2022] GET /compute/v2.1/servers/80fd9508-a183-4d46-a96e-ab26bebdbc22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:03:57.769441 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-f8d1e4bd-b6d8-4d5a-8255-0749be2bb202 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:57.769984 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f8d1e4bd-b6d8-4d5a-8255-0749be2bb202 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:57.772196 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-6808e5f8-47ec-4ab8-b0fd-da2a63d17f8d req-f3c68d39-4620-4870-bf3f-691298c2ce20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe7e7c5-28ce-436c-bdf2-486e17cd8928", "tag": "15690f10-2ae5-4510-a8e1-752ef9c31ba6"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:03:57.776569 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f8d1e4bd-b6d8-4d5a-8255-0749be2bb202 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:57.777098 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f8d1e4bd-b6d8-4d5a-8255-0749be2bb202 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:57.777873 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f8d1e4bd-b6d8-4d5a-8255-0749be2bb202 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:57.778548 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-f8d1e4bd-b6d8-4d5a-8255-0749be2bb202 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:57.783658 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6808e5f8-47ec-4ab8-b0fd-da2a63d17f8d req-f3c68d39-4620-4870-bf3f-691298c2ce20 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:57.783977 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-6808e5f8-47ec-4ab8-b0fd-da2a63d17f8d req-f3c68d39-4620-4870-bf3f-691298c2ce20 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:57.796042 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-6808e5f8-47ec-4ab8-b0fd-da2a63d17f8d req-f3c68d39-4620-4870-bf3f-691298c2ce20 service nova] Creating event network-changed:15690f10-2ae5-4510-a8e1-752ef9c31ba6 for instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 on hv-cinder-84984 Jul 20 18:03:57.801757 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-6808e5f8-47ec-4ab8-b0fd-da2a63d17f8d req-f3c68d39-4620-4870-bf3f-691298c2ce20 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034273 Jul 20 18:03:57.803023 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 598/1204] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:03:57.808265 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-f8d1e4bd-b6d8-4d5a-8255-0749be2bb202 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Going to try to terminate instance {{(pid=124846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 18:03:58.349554 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-f8d1e4bd-b6d8-4d5a-8255-0749be2bb202 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 204 len: 0 microversion: 2.1 time: 0.584409 Jul 20 18:03:58.354113 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 607/1205] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 18:03:57 2022] DELETE /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 18:03:58.361462 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-ccfab963-b8b9-41ac-b81e-56aa23c97900 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:58.367498 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-ccfab963-b8b9-41ac-b81e-56aa23c97900 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:58.372920 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ccfab963-b8b9-41ac-b81e-56aa23c97900 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:58.373684 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ccfab963-b8b9-41ac-b81e-56aa23c97900 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:58.375272 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ccfab963-b8b9-41ac-b81e-56aa23c97900 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:58.375952 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-ccfab963-b8b9-41ac-b81e-56aa23c97900 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:58.609387 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-ccfab963-b8b9-41ac-b81e-56aa23c97900 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:58.618965 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-ccfab963-b8b9-41ac-b81e-56aa23c97900 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1577 microversion: 2.1 time: 0.263193 Jul 20 18:03:58.619640 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 599/1206] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:58 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1577 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:03:59.637179 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-83634226-ebaa-4bcd-a2ee-b044d0c273f0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:03:59.637872 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-83634226-ebaa-4bcd-a2ee-b044d0c273f0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:03:59.645158 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-83634226-ebaa-4bcd-a2ee-b044d0c273f0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:59.645607 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-83634226-ebaa-4bcd-a2ee-b044d0c273f0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:59.646369 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-83634226-ebaa-4bcd-a2ee-b044d0c273f0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:03:59.646792 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-83634226-ebaa-4bcd-a2ee-b044d0c273f0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:03:59.808581 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-83634226-ebaa-4bcd-a2ee-b044d0c273f0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:03:59.816222 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-83634226-ebaa-4bcd-a2ee-b044d0c273f0 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1458 microversion: 2.1 time: 0.183379 Jul 20 18:03:59.834863 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 608/1207] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:03:59 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1458 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:04:00.696737 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [req-709a0b30-3edb-4b5a-ac96-8516555e48ea req-22419f8c-a434-41db-bfed-b121043af3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe7e7c5-28ce-436c-bdf2-486e17cd8928", "name": "network-vif-deleted", "tag": "15690f10-2ae5-4510-a8e1-752ef9c31ba6"}]} {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 18:04:00.707854 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-709a0b30-3edb-4b5a-ac96-8516555e48ea req-22419f8c-a434-41db-bfed-b121043af3d8 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:00.708293 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [req-709a0b30-3edb-4b5a-ac96-8516555e48ea req-22419f8c-a434-41db-bfed-b121043af3d8 service nova] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:00.720205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.compute.server_external_events [req-709a0b30-3edb-4b5a-ac96-8516555e48ea req-22419f8c-a434-41db-bfed-b121043af3d8 service nova] Creating event network-vif-deleted:15690f10-2ae5-4510-a8e1-752ef9c31ba6 for instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 on hv-cinder-84984 Jul 20 18:04:00.729200 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [req-709a0b30-3edb-4b5a-ac96-8516555e48ea req-22419f8c-a434-41db-bfed-b121043af3d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034001 Jul 20 18:04:00.729200 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 600/1208] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jul 20 18:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 18:04:00.850938 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-63547cb0-dc5e-4160-aa9e-3c4087c3c25b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:04:00.851639 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-63547cb0-dc5e-4160-aa9e-3c4087c3c25b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:04:00.858350 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-63547cb0-dc5e-4160-aa9e-3c4087c3c25b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:00.861302 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-63547cb0-dc5e-4160-aa9e-3c4087c3c25b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:00.861302 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-63547cb0-dc5e-4160-aa9e-3c4087c3c25b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:00.861302 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-63547cb0-dc5e-4160-aa9e-3c4087c3c25b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:00.924769 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.policy [None req-63547cb0-dc5e-4160-aa9e-3c4087c3c25b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:04:00.932514 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-63547cb0-dc5e-4160-aa9e-3c4087c3c25b tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1390 microversion: 2.1 time: 0.085562 Jul 20 18:04:00.933102 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 609/1209] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:04:00 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 18:04:01.950904 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:04:01.951687 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:04:01.958416 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:01.958860 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:01.959629 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:01.960061 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:01.994205 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:01.994648 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:01.995096 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.objects.instance [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lazy-loading 'fault' on Instance uuid 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 {{(pid=124845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 18:04:02.039874 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.policy [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c95e9df33ad4f819f26fb8b695df7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1213650f38494aa2aeb1aadc7ccbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 18:04:02.047883 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-88bf63fe-4e76-430c-9441-be0c8ececc65 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 200 len: 1229 microversion: 2.1 time: 0.101445 Jul 20 18:04:02.048482 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 601/1210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:04:01 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 18:04:03.066095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:04:03.066741 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 4fe7e7c5-28ce-436c-bdf2-486e17cd8928] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:04:03.073981 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:03.074710 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:03.075466 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:03.076010 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:03.091378 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] HTTP exception thrown: Instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 could not be found. Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Request method failure captured: Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 HTTP/1.1 Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EHkB9X-W9u1AXPktfbc67p2akARB0zxGQo1NwsEnBd69tV2k03ACyc0c3QbThzhHRvlJ6KLa4Ai8W2pGZoSV_U8J1MCE2JXJMMcyfmw_9VRtyHh_5oTwTbCA-JLmOQaIg9akJ8S-IKz3ilozfE_cG5CYBdsJlFnNpyAvYFC4MXT5GA Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 18:04:03.097521 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be1213650f38494aa2aeb1aadc7ccbc7"}]}] Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-TestVolumeBootPattern-35907800 Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-TestVolumeBootPattern-35907800-project Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 9c95e9df33ad4f819f26fb8b695df7e9 Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-TestVolumeBootPattern-35907800-project Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 could not be found. Jul 20 18:04:03.101096 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '4fe7e7c5-28ce-436c-bdf2-486e17cd8928'} Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 could not be found. Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:04:03.102934 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 could not be found. Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 could not be found. Jul 20 18:04:03.104277 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.105564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Returning 404 to user: Instance 4fe7e7c5-28ce-436c-bdf2-486e17cd8928 could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:04:03.105564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-dee57c48-260b-4cd3-bac5-14a4b3974fa5 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928" status: 404 len: 111 microversion: 2.1 time: 0.033238 Jul 20 18:04:03.105564 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 610/1211] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:04:03 2022] GET /compute/v2.1/servers/4fe7e7c5-28ce-436c-bdf2-486e17cd8928 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:04:03.800506 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:04:03.801320 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.compute.api [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:04:03.808546 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:03.809000 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:03.809763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:03.810198 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG oslo_concurrency.lockutils [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:03.823384 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.wsgi [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] HTTP exception thrown: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Request method failure captured: Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: request: DELETE /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a HTTP/1.1 Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept: application/json Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Accept-Encoding: identity Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Connection: close Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Length: 0 Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Content-Type: application/json Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Host: 10.222.0.42 Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Openstack-System-Scope: None Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: User-Agent: python-urllib3/1.26.9 Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Auth-Token: gAAAAABi2EHkB9X-W9u1AXPktfbc67p2akARB0zxGQo1NwsEnBd69tV2k03ACyc0c3QbThzhHRvlJ6KLa4Ai8W2pGZoSV_U8J1MCE2JXJMMcyfmw_9VRtyHh_5oTwTbCA-JLmOQaIg9akJ8S-IKz3ilozfE_cG5CYBdsJlFnNpyAvYFC4MXT5GA Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Id: None Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Domain-Name: None Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Identity-Status: Confirmed Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Is-Admin-Project: True Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Id: default Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Domain-Name: Default Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Project-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Role: member,reader Jul 20 18:04:03.825313 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Roles: member,reader Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be1213650f38494aa2aeb1aadc7ccbc7"}]}] Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant: tempest-TestVolumeBootPattern-35907800 Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-Tenant-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User: tempest-TestVolumeBootPattern-35907800-project Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Id: default Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Domain-Name: Default Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Id: 9c95e9df33ad4f819f26fb8b695df7e9 Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: X-User-Name: tempest-TestVolumeBootPattern-35907800-project Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: method: > Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: exception: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.827003 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: action_args: {'id': '3cbdc617-0892-491a-9baf-97c8bb00d86a'} Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:04:03.828014 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.830154 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.831763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Returning 404 to user: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. {{(pid=124845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:04:03.831763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-6c8f61d2-fcfe-4955-809c-fd5bf71466e8 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 404 len: 111 microversion: 2.1 time: 0.030153 Jul 20 18:04:03.831763 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 602/1212] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jul 20 18:04:03 2022] DELETE /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 18:04:03.836452 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '>' {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:04:03.837068 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.compute.api [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] [instance: 3cbdc617-0892-491a-9baf-97c8bb00d86a] Fetching instance by UUID {{(pid=124846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 18:04:03.843038 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:03.843486 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:03.844246 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 18:04:03.844714 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG oslo_concurrency.lockutils [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Lock "397f007f-3d37-459b-b899-f40f0f346dd0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 18:04:03.861020 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.wsgi [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] HTTP exception thrown: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Request method failure captured: Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: request: GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a HTTP/1.1 Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept: application/json Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Accept-Encoding: identity Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Connection: close Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Length: 0 Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Content-Type: application/json Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Host: 10.222.0.42 Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Openstack-System-Scope: None Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: User-Agent: python-urllib3/1.26.9 Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Auth-Token: gAAAAABi2EHkB9X-W9u1AXPktfbc67p2akARB0zxGQo1NwsEnBd69tV2k03ACyc0c3QbThzhHRvlJ6KLa4Ai8W2pGZoSV_U8J1MCE2JXJMMcyfmw_9VRtyHh_5oTwTbCA-JLmOQaIg9akJ8S-IKz3ilozfE_cG5CYBdsJlFnNpyAvYFC4MXT5GA Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Id: None Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Domain-Name: None Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Identity-Status: Confirmed Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Is-Admin-Project: True Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Id: default Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Domain-Name: Default Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Project-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Role: member,reader Jul 20 18:04:03.862574 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Roles: member,reader Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/be1213650f38494aa2aeb1aadc7ccbc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/be1213650f38494aa2aeb1aadc7ccbc7"}]}] Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant: tempest-TestVolumeBootPattern-35907800 Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Id: be1213650f38494aa2aeb1aadc7ccbc7 Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-Tenant-Name: tempest-TestVolumeBootPattern-35907800 Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User: tempest-TestVolumeBootPattern-35907800-project Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Id: default Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Domain-Name: Default Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Id: 9c95e9df33ad4f819f26fb8b695df7e9 Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: X-User-Name: tempest-TestVolumeBootPattern-35907800-project Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: method: > Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: exception: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.864410 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: action_args: {'id': '3cbdc617-0892-491a-9baf-97c8bb00d86a'} Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: {{(pid=124846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 18:04:03.865377 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. Jul 20 18:04:03.866785 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: ERROR nova.api.openstack.wsgi Jul 20 18:04:03.868095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: DEBUG nova.api.openstack.wsgi [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Returning 404 to user: Instance 3cbdc617-0892-491a-9baf-97c8bb00d86a could not be found. {{(pid=124846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 18:04:03.868095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO nova.api.openstack.requestlog [None req-2d9d8c4e-991f-4fc7-bb06-d33d6b15b804 tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a" status: 404 len: 111 microversion: 2.1 time: 0.031666 Jul 20 18:04:03.868095 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: [pid: 124846|app: 0|req: 611/1213] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jul 20 18:04:03 2022] GET /compute/v2.1/servers/3cbdc617-0892-491a-9baf-97c8bb00d86a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 18:04:08.252125 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: DEBUG nova.api.openstack.wsgi [None req-da29ef41-5f21-44c3-9cb5-6471e9f3d9bb tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] Calling method '.version_select at 0x7f7d3e138c10>' {{(pid=124845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 18:04:08.367613 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO nova.api.openstack.requestlog [None req-da29ef41-5f21-44c3-9cb5-6471e9f3d9bb tempest-TestVolumeBootPattern-35907800 tempest-TestVolumeBootPattern-35907800-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-240885777" status: 202 len: 0 microversion: 2.1 time: 0.119117 Jul 20 18:04:08.368222 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: [pid: 124845|app: 0|req: 603/1214] 10.222.0.42 () {58 vars in 1259 bytes} [Wed Jul 20 18:04:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-240885777 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 18:06:11.060862 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 18:06:11.061536 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Wed Jul 20 18:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 18:06:18.835417 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 18:06:18.836101 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Wed Jul 20 18:06:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 18:06:22.390450 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 18:06:22.391023 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Wed Jul 20 18:06:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 18:09:31.071623 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 18:09:31.072839 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Wed Jul 20 18:09:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 18:09:38.843600 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 18:09:38.844329 dv-cinder-849846-3-iscsi devstack@n-api.service[124846]: Wed Jul 20 18:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 18:09:42.399716 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 18:09:42.400308 dv-cinder-849846-3-iscsi devstack@n-api.service[124845]: Wed Jul 20 18:09:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!